&&&& RUNNING TensorRT.trtexec # trtexec --onnx=/weights/onnx/model.onnx --shapes=input:8x256x256x3 --fp16 --workspace=40000 --verbose [07/23/2021-23:45:35] [I] === Model Options === [07/23/2021-23:45:35] [I] Format: ONNX [07/23/2021-23:45:35] [I] Model: /weights/onnx/model.onnx [07/23/2021-23:45:35] [I] Output: [07/23/2021-23:45:35] [I] === Build Options === [07/23/2021-23:45:35] [I] Max batch: explicit [07/23/2021-23:45:35] [I] Workspace: 40000 MiB [07/23/2021-23:45:35] [I] minTiming: 1 [07/23/2021-23:45:35] [I] avgTiming: 8 [07/23/2021-23:45:35] [I] Precision: FP32+FP16 [07/23/2021-23:45:35] [I] Calibration: [07/23/2021-23:45:35] [I] Refit: Disabled [07/23/2021-23:45:35] [I] Safe mode: Disabled [07/23/2021-23:45:35] [I] Save engine: [07/23/2021-23:45:35] [I] Load engine: [07/23/2021-23:45:35] [I] Builder Cache: Enabled [07/23/2021-23:45:35] [I] NVTX verbosity: 0 [07/23/2021-23:45:35] [I] Tactic sources: Using default tactic sources [07/23/2021-23:45:35] [I] Input(s)s format: fp32:CHW [07/23/2021-23:45:35] [I] Output(s)s format: fp32:CHW [07/23/2021-23:45:35] [I] Input build shape: input=8x256x256x3+8x256x256x3+8x256x256x3 [07/23/2021-23:45:35] [I] Input calibration shapes: model [07/23/2021-23:45:35] [I] === System Options === [07/23/2021-23:45:35] [I] Device: 0 [07/23/2021-23:45:35] [I] DLACore: [07/23/2021-23:45:35] [I] Plugins: [07/23/2021-23:45:35] [I] === Inference Options === [07/23/2021-23:45:35] [I] Batch: Explicit [07/23/2021-23:45:35] [I] Input inference shape: input=8x256x256x3 [07/23/2021-23:45:35] [I] Iterations: 10 [07/23/2021-23:45:35] [I] Duration: 3s (+ 200ms warm up) [07/23/2021-23:45:35] [I] Sleep time: 0ms [07/23/2021-23:45:35] [I] Streams: 1 [07/23/2021-23:45:35] [I] ExposeDMA: Disabled [07/23/2021-23:45:35] [I] Data transfers: Enabled [07/23/2021-23:45:35] [I] Spin-wait: Disabled [07/23/2021-23:45:35] [I] Multithreading: Disabled [07/23/2021-23:45:35] [I] CUDA Graph: Disabled [07/23/2021-23:45:35] [I] Separate profiling: Disabled [07/23/2021-23:45:35] [I] Skip inference: Disabled [07/23/2021-23:45:35] [I] Inputs: [07/23/2021-23:45:35] [I] === Reporting Options === [07/23/2021-23:45:35] [I] Verbose: Enabled [07/23/2021-23:45:35] [I] Averages: 10 inferences [07/23/2021-23:45:35] [I] Percentile: 99 [07/23/2021-23:45:35] [I] Dump refittable layers:Disabled [07/23/2021-23:45:35] [I] Dump output: Disabled [07/23/2021-23:45:35] [I] Profile: Disabled [07/23/2021-23:45:35] [I] Export timing to JSON file: [07/23/2021-23:45:35] [I] Export output to JSON file: [07/23/2021-23:45:35] [I] Export profile to JSON file: [07/23/2021-23:45:35] [I] [07/23/2021-23:45:35] [I] === Device Information === [07/23/2021-23:45:35] [I] Selected Device: NVIDIA RTX A6000 [07/23/2021-23:45:35] [I] Compute Capability: 8.6 [07/23/2021-23:45:35] [I] SMs: 84 [07/23/2021-23:45:35] [I] Compute Clock Rate: 1.8 GHz [07/23/2021-23:45:35] [I] Device Global Memory: 45631 MiB [07/23/2021-23:45:35] [I] Shared Memory per SM: 100 KiB [07/23/2021-23:45:35] [I] Memory Bus Width: 384 bits (ECC enabled) [07/23/2021-23:45:35] [I] Memory Clock Rate: 8.001 GHz [07/23/2021-23:45:35] [I] [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::BatchTilePlugin_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::CoordConvAC version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::CropAndResizeDynamic version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::GenerateDetection_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::MultilevelCropAndResize_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::MultilevelProposeROI_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::NMSDynamic_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::Proposal version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::ProposalDynamic version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [07/23/2021-23:45:35] [V] [TRT] Registered plugin creator - ::Split version 1 [07/23/2021-23:45:40] [I] [TRT] ---------------------------------------------------------------- [07/23/2021-23:45:40] [I] [TRT] Input filename: /weights/onnx/model.onnx [07/23/2021-23:45:40] [I] [TRT] ONNX IR version: 0.0.7 [07/23/2021-23:45:40] [I] [TRT] Opset version: 13 [07/23/2021-23:45:40] [I] [TRT] Producer name: tf2onnx [07/23/2021-23:45:40] [I] [TRT] Producer version: 1.9.1 [07/23/2021-23:45:40] [I] [TRT] Domain: [07/23/2021-23:45:40] [I] [TRT] Model version: 0 [07/23/2021-23:45:40] [I] [TRT] Doc string: [07/23/2021-23:45:40] [I] [TRT] ---------------------------------------------------------------- [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::BatchTilePlugin_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::CoordConvAC version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::CropAndResizeDynamic version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::GenerateDetection_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::MultilevelCropAndResize_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::MultilevelProposeROI_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::NMSDynamic_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::Proposal version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::ProposalDynamic version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1 [07/23/2021-23:45:40] [V] [TRT] Plugin creator already registered - ::Split version 1 [07/23/2021-23:45:40] [V] [TRT] Adding network input: input with dtype: float32, dimensions: (-1, -1, -1, 3) [07/23/2021-23:45:40] [V] [TRT] Registering tensor: input for ONNX tensor: input [07/23/2021-23:45:40] [V] [TRT] Importing initializer: const_starts__255 [07/23/2021-23:45:40] [07/23/2021-23:45:40] [V] [TRT] Importing initializer: const_fold_opt__480 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: const_fold_opt__478 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: const_fold_opt__477 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: const_fold_opt__476 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: const_fold_opt__475 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: const_fold_opt__473 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: const_fold_opt__472 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: const_fold_opt__469 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: const_ends__260 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/output/Conv2D/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/output/BiasAdd/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose_const_slice_axes__218 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_5/Conv2D/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_5/BiasAdd/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_4/Conv2D/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_4/BiasAdd/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_3/Conv2D/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_3/BiasAdd/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_2/Conv2D/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_2/BiasAdd/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_1/Conv2D/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_1/BiasAdd/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d/Conv2D/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d/BiasAdd/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Importing initializer: Const__463 [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d/BiasAdd__9 [Transpose] [07/23/2021-23:45:40] [V] [TRT] Searching for input: input [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd__9 [Transpose] inputs: [input -> (-1, -1, -1, 3)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d/BiasAdd__9 for ONNX node: StatefulPartitionedCall/model/conv2d/BiasAdd__9 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d/BiasAdd__9:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d/BiasAdd__9:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd__9 [Transpose] outputs: [StatefulPartitionedCall/model/conv2d/BiasAdd__9:0 -> (-1, 3, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d/BiasAdd [Conv] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d/BiasAdd__9:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d/Conv2D/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d/BiasAdd/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d/BiasAdd__9:0 -> (-1, 3, -1, -1)], [StatefulPartitionedCall/model/conv2d/Conv2D/ReadVariableOp:0 -> (256, 3, 3, 3)], [StatefulPartitionedCall/model/conv2d/BiasAdd/ReadVariableOp:0 -> (256)], [07/23/2021-23:45:40] [V] [TRT] Convolution input dimensions: (-1, 3, -1, -1) [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d/BiasAdd [07/23/2021-23:45:40] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [07/23/2021-23:45:40] [V] [TRT] Convolution output dimensions: (-1, 256, -1, -1) [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d/BiasAdd:0 -> (-1, 256, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d/Relu [Relu] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d/Relu [Relu] inputs: [StatefulPartitionedCall/model/conv2d/BiasAdd:0 -> (-1, 256, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d/Relu for ONNX node: StatefulPartitionedCall/model/conv2d/Relu [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d/Relu:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d/Relu [Relu] outputs: [StatefulPartitionedCall/model/conv2d/Relu:0 -> (-1, 256, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_1/BiasAdd [Conv] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d/Relu:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_1/Conv2D/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_1/BiasAdd/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d/Relu:0 -> (-1, 256, -1, -1)], [StatefulPartitionedCall/model/conv2d_1/Conv2D/ReadVariableOp:0 -> (128, 256, 3, 3)], [StatefulPartitionedCall/model/conv2d_1/BiasAdd/ReadVariableOp:0 -> (128)], [07/23/2021-23:45:40] [V] [TRT] Convolution input dimensions: (-1, 256, -1, -1) [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_1/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_1/BiasAdd [07/23/2021-23:45:40] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [07/23/2021-23:45:40] [V] [TRT] Convolution output dimensions: (-1, 128, -1, -1) [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_1/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_1/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_1/BiasAdd:0 -> (-1, 128, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_1/Relu [Relu] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_1/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/Relu [Relu] inputs: [StatefulPartitionedCall/model/conv2d_1/BiasAdd:0 -> (-1, 128, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_1/Relu for ONNX node: StatefulPartitionedCall/model/conv2d_1/Relu [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_1/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_1/Relu:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/Relu [Relu] outputs: [StatefulPartitionedCall/model/conv2d_1/Relu:0 -> (-1, 128, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_2/BiasAdd [Conv] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_1/Relu:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_2/Conv2D/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_2/BiasAdd/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_1/Relu:0 -> (-1, 128, -1, -1)], [StatefulPartitionedCall/model/conv2d_2/Conv2D/ReadVariableOp:0 -> (64, 128, 3, 3)], [StatefulPartitionedCall/model/conv2d_2/BiasAdd/ReadVariableOp:0 -> (64)], [07/23/2021-23:45:40] [V] [TRT] Convolution input dimensions: (-1, 128, -1, -1) [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_2/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_2/BiasAdd [07/23/2021-23:45:40] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [07/23/2021-23:45:40] [V] [TRT] Convolution output dimensions: (-1, 64, -1, -1) [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_2/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_2/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_2/BiasAdd:0 -> (-1, 64, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_2/Relu [Relu] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_2/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/Relu [Relu] inputs: [StatefulPartitionedCall/model/conv2d_2/BiasAdd:0 -> (-1, 64, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_2/Relu for ONNX node: StatefulPartitionedCall/model/conv2d_2/Relu [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_2/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_2/Relu:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/Relu [Relu] outputs: [StatefulPartitionedCall/model/conv2d_2/Relu:0 -> (-1, 64, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_3/BiasAdd [Conv] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_2/Relu:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_3/Conv2D/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_3/BiasAdd/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_2/Relu:0 -> (-1, 64, -1, -1)], [StatefulPartitionedCall/model/conv2d_3/Conv2D/ReadVariableOp:0 -> (32, 64, 3, 3)], [StatefulPartitionedCall/model/conv2d_3/BiasAdd/ReadVariableOp:0 -> (32)], [07/23/2021-23:45:40] [V] [TRT] Convolution input dimensions: (-1, 64, -1, -1) [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_3/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_3/BiasAdd [07/23/2021-23:45:40] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32 [07/23/2021-23:45:40] [V] [TRT] Convolution output dimensions: (-1, 32, -1, -1) [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_3/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_3/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_3/BiasAdd:0 -> (-1, 32, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_3/Relu [Relu] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_3/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/Relu [Relu] inputs: [StatefulPartitionedCall/model/conv2d_3/BiasAdd:0 -> (-1, 32, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_3/Relu for ONNX node: StatefulPartitionedCall/model/conv2d_3/Relu [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_3/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_3/Relu:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/Relu [Relu] outputs: [StatefulPartitionedCall/model/conv2d_3/Relu:0 -> (-1, 32, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose [ConvTranspose] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_3/Relu:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose [ConvTranspose] inputs: [StatefulPartitionedCall/model/conv2d_3/Relu:0 -> (-1, 32, -1, -1)], [StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose/ReadVariableOp:0 -> (32, 32, 3, 3)], [07/23/2021-23:45:40] [V] [TRT] Running deconvolution with: Padding mode: NOTSET Pre-padding: (0, 0) Post-padding: (0, 0) [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose for ONNX node: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose [ConvTranspose] outputs: [StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose:0 -> (-1, 32, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Shape__359 [Shape] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose:0 [07/23/2021-23:45:40] [V] [TRT] Shape__359 [Shape] inputs: [StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose:0 -> (-1, 32, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Shape__359 for ONNX node: Shape__359 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Shape__359:0 for ONNX tensor: Shape__359:0 [07/23/2021-23:45:40] [V] [TRT] Shape__359 [Shape] outputs: [Shape__359:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Shape__353 [Shape] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_3/Relu:0 [07/23/2021-23:45:40] [V] [TRT] Shape__353 [Shape] inputs: [StatefulPartitionedCall/model/conv2d_3/Relu:0 -> (-1, 32, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Shape__353 for ONNX node: Shape__353 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Shape__353:0 for ONNX tensor: Shape__353:0 [07/23/2021-23:45:40] [V] [TRT] Shape__353 [Shape] outputs: [Shape__353:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Gather__362 [Gather] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Shape__359:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Const__463 [07/23/2021-23:45:40] [V] [TRT] Gather__362 [Gather] inputs: [Shape__359:0 -> (4)], [Const__463 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: Const__463 for ONNX initializer: Const__463 [07/23/2021-23:45:40] [V] [TRT] Using Gather axis: 0 [07/23/2021-23:45:40] [V] [TRT] Registering layer: Gather__362 for ONNX node: Gather__362 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Shape__67:0 for ONNX tensor: Shape__67:0 [07/23/2021-23:45:40] [V] [TRT] Gather__362 [Gather] outputs: [Shape__67:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Slice__76 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Shape__67:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__260 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Slice__76 [Slice] inputs: [Shape__67:0 -> (4)], [const_ends__202 -> (1)], [const_ends__260 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Slice__76 for ONNX node: Slice__76 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Slice__76:0 for ONNX tensor: Slice__76:0 [07/23/2021-23:45:40] [V] [TRT] Slice__76 [Slice] outputs: [Slice__76:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Slice__72 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Shape__67:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_starts__255 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Slice__72 [Slice] inputs: [Shape__67:0 -> (4)], [const_starts__255 -> (1)], [const_ends__202 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Slice__72 for ONNX node: Slice__72 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Slice__72:0 for ONNX tensor: Slice__72:0 [07/23/2021-23:45:40] [V] [TRT] Slice__72 [Slice] outputs: [Slice__72:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Gather__358 [Gather] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Shape__353:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Const__463 [07/23/2021-23:45:40] [V] [TRT] Gather__358 [Gather] inputs: [Shape__353:0 -> (4)], [Const__463 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: Const__463_0 for ONNX initializer: Const__463 [07/23/2021-23:45:40] [V] [TRT] Using Gather axis: 0 [07/23/2021-23:45:40] [V] [TRT] Registering layer: Gather__358 for ONNX node: Gather__358 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose/Shape:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose/Shape:0 [07/23/2021-23:45:40] [V] [TRT] Gather__358 [Gather] outputs: [StatefulPartitionedCall/model/conv2d_transpose/Shape:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose/Shape__41 [Cast] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose/Shape:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose/Shape__41 [Cast] inputs: [StatefulPartitionedCall/model/conv2d_transpose/Shape:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Casting to type: int32 [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose/Shape__41 for ONNX node: StatefulPartitionedCall/model/conv2d_transpose/Shape__41 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose/Shape__41:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose/Shape__41:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose/Shape__41 [Cast] outputs: [StatefulPartitionedCall/model/conv2d_transpose/Shape__41:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose/strided_slice_2 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose/Shape__41:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__260 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose/strided_slice_2 [Slice] inputs: [StatefulPartitionedCall/model/conv2d_transpose/Shape__41:0 -> (4)], [const_ends__202 -> (1)], [const_ends__260 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose/strided_slice_2 for ONNX node: StatefulPartitionedCall/model/conv2d_transpose/strided_slice_2 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose/strided_slice_2:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose/strided_slice_2:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose/strided_slice_2 [Slice] outputs: [StatefulPartitionedCall/model/conv2d_transpose/strided_slice_2:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose/strided_slice_1 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose/Shape__41:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_starts__255 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose/strided_slice_1 [Slice] inputs: [StatefulPartitionedCall/model/conv2d_transpose/Shape__41:0 -> (4)], [const_starts__255 -> (1)], [const_ends__202 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose/strided_slice_1 for ONNX node: StatefulPartitionedCall/model/conv2d_transpose/strided_slice_1 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose/strided_slice_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose/strided_slice_1:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose/strided_slice_1 [Slice] outputs: [StatefulPartitionedCall/model/conv2d_transpose/strided_slice_1:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose/strided_slice [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose/Shape__41:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_starts__255 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose/strided_slice [Slice] inputs: [StatefulPartitionedCall/model/conv2d_transpose/Shape__41:0 -> (4)], [const_axes__235 -> (1)], [const_starts__255 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose/strided_slice for ONNX node: StatefulPartitionedCall/model/conv2d_transpose/strided_slice [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose/strided_slice:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose/strided_slice:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose/strided_slice [Slice] outputs: [StatefulPartitionedCall/model/conv2d_transpose/strided_slice:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose/stack_Concat__65 [Concat] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose/strided_slice:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose/strided_slice_1:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose/strided_slice_2:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_fold_opt__469 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose/stack_Concat__65 [Concat] inputs: [StatefulPartitionedCall/model/conv2d_transpose/strided_slice:0 -> (1)], [StatefulPartitionedCall/model/conv2d_transpose/strided_slice_1:0 -> (1)], [StatefulPartitionedCall/model/conv2d_transpose/strided_slice_2:0 -> (1)], [const_fold_opt__469 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: const_fold_opt__469 for ONNX initializer: const_fold_opt__469 [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose/stack_Concat__65 for ONNX node: StatefulPartitionedCall/model/conv2d_transpose/stack_Concat__65 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose/stack_Concat__65:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose/stack_Concat__65:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose/stack_Concat__65 [Concat] outputs: [StatefulPartitionedCall/model/conv2d_transpose/stack_Concat__65:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Cast__66 [Cast] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose/stack_Concat__65:0 [07/23/2021-23:45:40] [V] [TRT] Cast__66 [Cast] inputs: [StatefulPartitionedCall/model/conv2d_transpose/stack_Concat__65:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Casting to type: int32 [07/23/2021-23:45:40] [V] [TRT] Registering layer: Cast__66 for ONNX node: Cast__66 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Cast__66:0 for ONNX tensor: Cast__66:0 [07/23/2021-23:45:40] [V] [TRT] Cast__66 [Cast] outputs: [Cast__66:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Slice__84 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Cast__66:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__260 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Slice__84 [Slice] inputs: [Cast__66:0 -> (4)], [const_ends__202 -> (1)], [const_ends__260 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Slice__84 for ONNX node: Slice__84 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Slice__84:0 for ONNX tensor: Slice__84:0 [07/23/2021-23:45:40] [V] [TRT] Slice__84 [Slice] outputs: [Slice__84:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Sub__86 [Sub] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__76:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__84:0 [07/23/2021-23:45:40] [V] [TRT] Sub__86 [Sub] inputs: [Slice__76:0 -> (1)], [Slice__84:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Sub__86 for ONNX node: Sub__86 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Sub__86:0 for ONNX tensor: Sub__86:0 [07/23/2021-23:45:40] [V] [TRT] Sub__86 [Sub] outputs: [Sub__86:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Div__89 [Div] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Sub__86:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Div__89 [Div] inputs: [Sub__86:0 -> (1)], [const_ends__202 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: const_ends__202 for ONNX initializer: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Registering layer: Div__89 for ONNX node: Div__89 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Div__89:0 for ONNX tensor: Div__89:0 [07/23/2021-23:45:40] [V] [TRT] Div__89 [Div] outputs: [Div__89:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Slice__80 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Cast__66:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_starts__255 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Slice__80 [Slice] inputs: [Cast__66:0 -> (4)], [const_starts__255 -> (1)], [const_ends__202 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Slice__80 for ONNX node: Slice__80 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Slice__80:0 for ONNX tensor: Slice__80:0 [07/23/2021-23:45:40] [V] [TRT] Slice__80 [Slice] outputs: [Slice__80:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Sub__85 [Sub] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__72:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__80:0 [07/23/2021-23:45:40] [V] [TRT] Sub__85 [Sub] inputs: [Slice__72:0 -> (1)], [Slice__80:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Sub__85 for ONNX node: Sub__85 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Sub__85:0 for ONNX tensor: Sub__85:0 [07/23/2021-23:45:40] [V] [TRT] Sub__85 [Sub] outputs: [Sub__85:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Div__88 [Div] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Sub__85:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Div__88 [Div] inputs: [Sub__85:0 -> (1)], [const_ends__202 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: const_ends__202_1 for ONNX initializer: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Registering layer: Div__88 for ONNX node: Div__88 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Div__88:0 for ONNX tensor: Div__88:0 [07/23/2021-23:45:40] [V] [TRT] Div__88 [Div] outputs: [Div__88:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Concat__92 [Concat] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Div__88:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Div__89:0 [07/23/2021-23:45:40] [V] [TRT] Concat__92 [Concat] inputs: [Div__88:0 -> (1)], [Div__89:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Concat__92 for ONNX node: Concat__92 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Concat__92:0 for ONNX tensor: Concat__92:0 [07/23/2021-23:45:40] [V] [TRT] Concat__92 [Concat] outputs: [Concat__92:0 -> (2)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Add__91 [Add] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Div__89:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__84:0 [07/23/2021-23:45:40] [V] [TRT] Add__91 [Add] inputs: [Div__89:0 -> (1)], [Slice__84:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Add__91 for ONNX node: Add__91 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Add__91:0 for ONNX tensor: Add__91:0 [07/23/2021-23:45:40] [V] [TRT] Add__91 [Add] outputs: [Add__91:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Add__90 [Add] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Div__88:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__80:0 [07/23/2021-23:45:40] [V] [TRT] Add__90 [Add] inputs: [Div__88:0 -> (1)], [Slice__80:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Add__90 for ONNX node: Add__90 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Add__90:0 for ONNX tensor: Add__90:0 [07/23/2021-23:45:40] [V] [TRT] Add__90 [Add] outputs: [Add__90:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Concat__93 [Concat] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Add__90:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Add__91:0 [07/23/2021-23:45:40] [V] [TRT] Concat__93 [Concat] inputs: [Add__90:0 -> (1)], [Add__91:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Concat__93 for ONNX node: Concat__93 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Concat__93:0 for ONNX tensor: Concat__93:0 [07/23/2021-23:45:40] [V] [TRT] Concat__93 [Concat] outputs: [Concat__93:0 -> (2)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Slice__95 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Concat__92:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Concat__93:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose_const_slice_axes__218 [07/23/2021-23:45:40] [V] [TRT] Slice__95 [Slice] inputs: [StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose:0 -> (-1, 32, -1, -1)], [Concat__92:0 -> (2)], [Concat__93:0 -> (2)], [StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose_const_slice_axes__218 -> (2)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Slice__95 for ONNX node: Slice__95 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Slice__95:0 for ONNX tensor: Slice__95:0 [07/23/2021-23:45:40] [V] [TRT] Slice__95 [Slice] outputs: [Slice__95:0 -> (-1, -1, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose/BiasAdd [Add] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__95:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_fold_opt__478 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose/BiasAdd [Add] inputs: [Slice__95:0 -> (-1, -1, -1, -1)], [const_fold_opt__478 -> (1, 32, 1, 1)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: const_fold_opt__478 for ONNX initializer: const_fold_opt__478 [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_transpose/BiasAdd [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose/BiasAdd [Add] outputs: [StatefulPartitionedCall/model/conv2d_transpose/BiasAdd:0 -> (-1, 32, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose/Relu [Relu] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose/Relu [Relu] inputs: [StatefulPartitionedCall/model/conv2d_transpose/BiasAdd:0 -> (-1, 32, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose/Relu for ONNX node: StatefulPartitionedCall/model/conv2d_transpose/Relu [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose/Relu:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose/Relu [Relu] outputs: [StatefulPartitionedCall/model/conv2d_transpose/Relu:0 -> (-1, 32, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose [ConvTranspose] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose/Relu:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose [ConvTranspose] inputs: [StatefulPartitionedCall/model/conv2d_transpose/Relu:0 -> (-1, 32, -1, -1)], [StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose/ReadVariableOp:0 -> (32, 64, 3, 3)], [07/23/2021-23:45:40] [V] [TRT] Running deconvolution with: Padding mode: NOTSET Pre-padding: (0, 0) Post-padding: (0, 0) [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose [ConvTranspose] outputs: [StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose:0 -> (-1, 64, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Shape__387 [Shape] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose:0 [07/23/2021-23:45:40] [V] [TRT] Shape__387 [Shape] inputs: [StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose:0 -> (-1, 64, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Shape__387 for ONNX node: Shape__387 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Shape__387:0 for ONNX tensor: Shape__387:0 [07/23/2021-23:45:40] [V] [TRT] Shape__387 [Shape] outputs: [Shape__387:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Gather__390 [Gather] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Shape__387:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Const__463 [07/23/2021-23:45:40] [V] [TRT] Gather__390 [Gather] inputs: [Shape__387:0 -> (4)], [Const__463 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: Const__463_2 for ONNX initializer: Const__463 [07/23/2021-23:45:40] [V] [TRT] Using Gather axis: 0 [07/23/2021-23:45:40] [V] [TRT] Registering layer: Gather__390 for ONNX node: Gather__390 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Shape__129:0 for ONNX tensor: Shape__129:0 [07/23/2021-23:45:40] [V] [TRT] Gather__390 [Gather] outputs: [Shape__129:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Slice__138 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Shape__129:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__260 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Slice__138 [Slice] inputs: [Shape__129:0 -> (4)], [const_ends__202 -> (1)], [const_ends__260 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Slice__138 for ONNX node: Slice__138 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Slice__138:0 for ONNX tensor: Slice__138:0 [07/23/2021-23:45:40] [V] [TRT] Slice__138 [Slice] outputs: [Slice__138:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Slice__134 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Shape__129:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_starts__255 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Slice__134 [Slice] inputs: [Shape__129:0 -> (4)], [const_starts__255 -> (1)], [const_ends__202 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Slice__134 for ONNX node: Slice__134 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Slice__134:0 for ONNX tensor: Slice__134:0 [07/23/2021-23:45:40] [V] [TRT] Slice__134 [Slice] outputs: [Slice__134:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Shape__447 [Shape] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose/Relu:0 [07/23/2021-23:45:40] [V] [TRT] Shape__447 [Shape] inputs: [StatefulPartitionedCall/model/conv2d_transpose/Relu:0 -> (-1, 32, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Shape__447 for ONNX node: Shape__447 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Shape__447:0 for ONNX tensor: Shape__447:0 [07/23/2021-23:45:40] [V] [TRT] Shape__447 [Shape] outputs: [Shape__447:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Gather__452 [Gather] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Shape__447:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Const__463 [07/23/2021-23:45:40] [V] [TRT] Gather__452 [Gather] inputs: [Shape__447:0 -> (4)], [Const__463 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: Const__463_3 for ONNX initializer: Const__463 [07/23/2021-23:45:40] [V] [TRT] Using Gather axis: 0 [07/23/2021-23:45:40] [V] [TRT] Registering layer: Gather__452 for ONNX node: Gather__452 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_1/Shape:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_1/Shape:0 [07/23/2021-23:45:40] [V] [TRT] Gather__452 [Gather] outputs: [StatefulPartitionedCall/model/conv2d_transpose_1/Shape:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_1/Shape__103 [Cast] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_1/Shape:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_1/Shape__103 [Cast] inputs: [StatefulPartitionedCall/model/conv2d_transpose_1/Shape:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Casting to type: int32 [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_1/Shape__103 for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_1/Shape__103 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_1/Shape__103:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_1/Shape__103:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_1/Shape__103 [Cast] outputs: [StatefulPartitionedCall/model/conv2d_transpose_1/Shape__103:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice_2 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_1/Shape__103:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__260 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice_2 [Slice] inputs: [StatefulPartitionedCall/model/conv2d_transpose_1/Shape__103:0 -> (4)], [const_ends__202 -> (1)], [const_ends__260 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice_2 for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice_2 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice_2:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice_2:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice_2 [Slice] outputs: [StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice_2:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice_1 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_1/Shape__103:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_starts__255 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice_1 [Slice] inputs: [StatefulPartitionedCall/model/conv2d_transpose_1/Shape__103:0 -> (4)], [const_starts__255 -> (1)], [const_ends__202 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice_1 for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice_1 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice_1:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice_1 [Slice] outputs: [StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice_1:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_1/Shape__103:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_starts__255 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice [Slice] inputs: [StatefulPartitionedCall/model/conv2d_transpose_1/Shape__103:0 -> (4)], [const_axes__235 -> (1)], [const_starts__255 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice [Slice] outputs: [StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_1/stack_Concat__127 [Concat] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice_1:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice_2:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_fold_opt__473 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_1/stack_Concat__127 [Concat] inputs: [StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice:0 -> (1)], [StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice_1:0 -> (1)], [StatefulPartitionedCall/model/conv2d_transpose_1/strided_slice_2:0 -> (1)], [const_fold_opt__473 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: const_fold_opt__473 for ONNX initializer: const_fold_opt__473 [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_1/stack_Concat__127 for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_1/stack_Concat__127 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_1/stack_Concat__127:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_1/stack_Concat__127:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_1/stack_Concat__127 [Concat] outputs: [StatefulPartitionedCall/model/conv2d_transpose_1/stack_Concat__127:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Cast__128 [Cast] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_1/stack_Concat__127:0 [07/23/2021-23:45:40] [V] [TRT] Cast__128 [Cast] inputs: [StatefulPartitionedCall/model/conv2d_transpose_1/stack_Concat__127:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Casting to type: int32 [07/23/2021-23:45:40] [V] [TRT] Registering layer: Cast__128 for ONNX node: Cast__128 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Cast__128:0 for ONNX tensor: Cast__128:0 [07/23/2021-23:45:40] [V] [TRT] Cast__128 [Cast] outputs: [Cast__128:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Slice__146 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Cast__128:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__260 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Slice__146 [Slice] inputs: [Cast__128:0 -> (4)], [const_ends__202 -> (1)], [const_ends__260 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Slice__146 for ONNX node: Slice__146 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Slice__146:0 for ONNX tensor: Slice__146:0 [07/23/2021-23:45:40] [V] [TRT] Slice__146 [Slice] outputs: [Slice__146:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Sub__148 [Sub] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__138:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__146:0 [07/23/2021-23:45:40] [V] [TRT] Sub__148 [Sub] inputs: [Slice__138:0 -> (1)], [Slice__146:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Sub__148 for ONNX node: Sub__148 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Sub__148:0 for ONNX tensor: Sub__148:0 [07/23/2021-23:45:40] [V] [TRT] Sub__148 [Sub] outputs: [Sub__148:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Div__151 [Div] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Sub__148:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Div__151 [Div] inputs: [Sub__148:0 -> (1)], [const_ends__202 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: const_ends__202_4 for ONNX initializer: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Registering layer: Div__151 for ONNX node: Div__151 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Div__151:0 for ONNX tensor: Div__151:0 [07/23/2021-23:45:40] [V] [TRT] Div__151 [Div] outputs: [Div__151:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Slice__142 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Cast__128:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_starts__255 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Slice__142 [Slice] inputs: [Cast__128:0 -> (4)], [const_starts__255 -> (1)], [const_ends__202 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Slice__142 for ONNX node: Slice__142 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Slice__142:0 for ONNX tensor: Slice__142:0 [07/23/2021-23:45:40] [V] [TRT] Slice__142 [Slice] outputs: [Slice__142:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Sub__147 [Sub] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__134:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__142:0 [07/23/2021-23:45:40] [V] [TRT] Sub__147 [Sub] inputs: [Slice__134:0 -> (1)], [Slice__142:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Sub__147 for ONNX node: Sub__147 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Sub__147:0 for ONNX tensor: Sub__147:0 [07/23/2021-23:45:40] [V] [TRT] Sub__147 [Sub] outputs: [Sub__147:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Div__150 [Div] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Sub__147:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Div__150 [Div] inputs: [Sub__147:0 -> (1)], [const_ends__202 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: const_ends__202_5 for ONNX initializer: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Registering layer: Div__150 for ONNX node: Div__150 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Div__150:0 for ONNX tensor: Div__150:0 [07/23/2021-23:45:40] [V] [TRT] Div__150 [Div] outputs: [Div__150:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Concat__154 [Concat] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Div__150:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Div__151:0 [07/23/2021-23:45:40] [V] [TRT] Concat__154 [Concat] inputs: [Div__150:0 -> (1)], [Div__151:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Concat__154 for ONNX node: Concat__154 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Concat__154:0 for ONNX tensor: Concat__154:0 [07/23/2021-23:45:40] [V] [TRT] Concat__154 [Concat] outputs: [Concat__154:0 -> (2)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Add__153 [Add] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Div__151:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__146:0 [07/23/2021-23:45:40] [V] [TRT] Add__153 [Add] inputs: [Div__151:0 -> (1)], [Slice__146:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Add__153 for ONNX node: Add__153 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Add__153:0 for ONNX tensor: Add__153:0 [07/23/2021-23:45:40] [V] [TRT] Add__153 [Add] outputs: [Add__153:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Add__152 [Add] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Div__150:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__142:0 [07/23/2021-23:45:40] [V] [TRT] Add__152 [Add] inputs: [Div__150:0 -> (1)], [Slice__142:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Add__152 for ONNX node: Add__152 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Add__152:0 for ONNX tensor: Add__152:0 [07/23/2021-23:45:40] [V] [TRT] Add__152 [Add] outputs: [Add__152:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Concat__155 [Concat] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Add__152:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Add__153:0 [07/23/2021-23:45:40] [V] [TRT] Concat__155 [Concat] inputs: [Add__152:0 -> (1)], [Add__153:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Concat__155 for ONNX node: Concat__155 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Concat__155:0 for ONNX tensor: Concat__155:0 [07/23/2021-23:45:40] [V] [TRT] Concat__155 [Concat] outputs: [Concat__155:0 -> (2)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Slice__157 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Concat__154:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Concat__155:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose_const_slice_axes__218 [07/23/2021-23:45:40] [V] [TRT] Slice__157 [Slice] inputs: [StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose:0 -> (-1, 64, -1, -1)], [Concat__154:0 -> (2)], [Concat__155:0 -> (2)], [StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose_const_slice_axes__218 -> (2)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Slice__157 for ONNX node: Slice__157 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Slice__157:0 for ONNX tensor: Slice__157:0 [07/23/2021-23:45:40] [V] [TRT] Slice__157 [Slice] outputs: [Slice__157:0 -> (-1, -1, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_1/BiasAdd [Add] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__157:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_fold_opt__475 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_1/BiasAdd [Add] inputs: [Slice__157:0 -> (-1, -1, -1, -1)], [const_fold_opt__475 -> (1, 64, 1, 1)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: const_fold_opt__475 for ONNX initializer: const_fold_opt__475 [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_1/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_1/BiasAdd [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_1/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_1/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_1/BiasAdd [Add] outputs: [StatefulPartitionedCall/model/conv2d_transpose_1/BiasAdd:0 -> (-1, 64, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_1/Relu [Relu] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_1/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_1/Relu [Relu] inputs: [StatefulPartitionedCall/model/conv2d_transpose_1/BiasAdd:0 -> (-1, 64, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_1/Relu for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_1/Relu [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_1/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_1/Relu:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_1/Relu [Relu] outputs: [StatefulPartitionedCall/model/conv2d_transpose_1/Relu:0 -> (-1, 64, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose [ConvTranspose] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_1/Relu:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose [ConvTranspose] inputs: [StatefulPartitionedCall/model/conv2d_transpose_1/Relu:0 -> (-1, 64, -1, -1)], [StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose/ReadVariableOp:0 -> (64, 128, 3, 3)], [07/23/2021-23:45:40] [V] [TRT] Running deconvolution with: Padding mode: NOTSET Pre-padding: (0, 0) Post-padding: (0, 0) [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose [ConvTranspose] outputs: [StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose:0 -> (-1, 128, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Shape__391 [Shape] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose:0 [07/23/2021-23:45:40] [V] [TRT] Shape__391 [Shape] inputs: [StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose:0 -> (-1, 128, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Shape__391 for ONNX node: Shape__391 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Shape__391:0 for ONNX tensor: Shape__391:0 [07/23/2021-23:45:40] [V] [TRT] Shape__391 [Shape] outputs: [Shape__391:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Gather__394 [Gather] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Shape__391:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Const__463 [07/23/2021-23:45:40] [V] [TRT] Gather__394 [Gather] inputs: [Shape__391:0 -> (4)], [Const__463 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: Const__463_6 for ONNX initializer: Const__463 [07/23/2021-23:45:40] [V] [TRT] Using Gather axis: 0 [07/23/2021-23:45:40] [V] [TRT] Registering layer: Gather__394 for ONNX node: Gather__394 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Shape__191:0 for ONNX tensor: Shape__191:0 [07/23/2021-23:45:40] [V] [TRT] Gather__394 [Gather] outputs: [Shape__191:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Slice__200 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Shape__191:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__260 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Slice__200 [Slice] inputs: [Shape__191:0 -> (4)], [const_ends__202 -> (1)], [const_ends__260 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Slice__200 for ONNX node: Slice__200 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Slice__200:0 for ONNX tensor: Slice__200:0 [07/23/2021-23:45:40] [V] [TRT] Slice__200 [Slice] outputs: [Slice__200:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Slice__196 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Shape__191:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_starts__255 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Slice__196 [Slice] inputs: [Shape__191:0 -> (4)], [const_starts__255 -> (1)], [const_ends__202 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Slice__196 for ONNX node: Slice__196 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Slice__196:0 for ONNX tensor: Slice__196:0 [07/23/2021-23:45:40] [V] [TRT] Slice__196 [Slice] outputs: [Slice__196:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Shape__453 [Shape] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_1/Relu:0 [07/23/2021-23:45:40] [V] [TRT] Shape__453 [Shape] inputs: [StatefulPartitionedCall/model/conv2d_transpose_1/Relu:0 -> (-1, 64, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Shape__453 for ONNX node: Shape__453 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Shape__453:0 for ONNX tensor: Shape__453:0 [07/23/2021-23:45:40] [V] [TRT] Shape__453 [Shape] outputs: [Shape__453:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Gather__458 [Gather] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Shape__453:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Const__463 [07/23/2021-23:45:40] [V] [TRT] Gather__458 [Gather] inputs: [Shape__453:0 -> (4)], [Const__463 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: Const__463_7 for ONNX initializer: Const__463 [07/23/2021-23:45:40] [V] [TRT] Using Gather axis: 0 [07/23/2021-23:45:40] [V] [TRT] Registering layer: Gather__458 for ONNX node: Gather__458 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_2/Shape:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_2/Shape:0 [07/23/2021-23:45:40] [V] [TRT] Gather__458 [Gather] outputs: [StatefulPartitionedCall/model/conv2d_transpose_2/Shape:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_2/Shape__165 [Cast] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_2/Shape:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_2/Shape__165 [Cast] inputs: [StatefulPartitionedCall/model/conv2d_transpose_2/Shape:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Casting to type: int32 [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_2/Shape__165 for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_2/Shape__165 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_2/Shape__165:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_2/Shape__165:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_2/Shape__165 [Cast] outputs: [StatefulPartitionedCall/model/conv2d_transpose_2/Shape__165:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice_2 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_2/Shape__165:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__260 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice_2 [Slice] inputs: [StatefulPartitionedCall/model/conv2d_transpose_2/Shape__165:0 -> (4)], [const_ends__202 -> (1)], [const_ends__260 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice_2 for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice_2 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice_2:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice_2:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice_2 [Slice] outputs: [StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice_2:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice_1 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_2/Shape__165:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_starts__255 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice_1 [Slice] inputs: [StatefulPartitionedCall/model/conv2d_transpose_2/Shape__165:0 -> (4)], [const_starts__255 -> (1)], [const_ends__202 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice_1 for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice_1 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice_1:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice_1 [Slice] outputs: [StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice_1:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_2/Shape__165:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_starts__255 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice [Slice] inputs: [StatefulPartitionedCall/model/conv2d_transpose_2/Shape__165:0 -> (4)], [const_axes__235 -> (1)], [const_starts__255 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice [Slice] outputs: [StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_2/stack_Concat__189 [Concat] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice_1:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice_2:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_fold_opt__472 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_2/stack_Concat__189 [Concat] inputs: [StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice:0 -> (1)], [StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice_1:0 -> (1)], [StatefulPartitionedCall/model/conv2d_transpose_2/strided_slice_2:0 -> (1)], [const_fold_opt__472 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: const_fold_opt__472 for ONNX initializer: const_fold_opt__472 [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_2/stack_Concat__189 for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_2/stack_Concat__189 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_2/stack_Concat__189:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_2/stack_Concat__189:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_2/stack_Concat__189 [Concat] outputs: [StatefulPartitionedCall/model/conv2d_transpose_2/stack_Concat__189:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Cast__190 [Cast] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_2/stack_Concat__189:0 [07/23/2021-23:45:40] [V] [TRT] Cast__190 [Cast] inputs: [StatefulPartitionedCall/model/conv2d_transpose_2/stack_Concat__189:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Casting to type: int32 [07/23/2021-23:45:40] [V] [TRT] Registering layer: Cast__190 for ONNX node: Cast__190 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Cast__190:0 for ONNX tensor: Cast__190:0 [07/23/2021-23:45:40] [V] [TRT] Cast__190 [Cast] outputs: [Cast__190:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Slice__208 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Cast__190:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__260 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Slice__208 [Slice] inputs: [Cast__190:0 -> (4)], [const_ends__202 -> (1)], [const_ends__260 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Slice__208 for ONNX node: Slice__208 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Slice__208:0 for ONNX tensor: Slice__208:0 [07/23/2021-23:45:40] [V] [TRT] Slice__208 [Slice] outputs: [Slice__208:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Sub__210 [Sub] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__200:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__208:0 [07/23/2021-23:45:40] [V] [TRT] Sub__210 [Sub] inputs: [Slice__200:0 -> (1)], [Slice__208:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Sub__210 for ONNX node: Sub__210 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Sub__210:0 for ONNX tensor: Sub__210:0 [07/23/2021-23:45:40] [V] [TRT] Sub__210 [Sub] outputs: [Sub__210:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Div__213 [Div] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Sub__210:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Div__213 [Div] inputs: [Sub__210:0 -> (1)], [const_ends__202 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: const_ends__202_8 for ONNX initializer: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Registering layer: Div__213 for ONNX node: Div__213 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Div__213:0 for ONNX tensor: Div__213:0 [07/23/2021-23:45:40] [V] [TRT] Div__213 [Div] outputs: [Div__213:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Add__215 [Add] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Div__213:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__208:0 [07/23/2021-23:45:40] [V] [TRT] Add__215 [Add] inputs: [Div__213:0 -> (1)], [Slice__208:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Add__215 for ONNX node: Add__215 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Add__215:0 for ONNX tensor: Add__215:0 [07/23/2021-23:45:40] [V] [TRT] Add__215 [Add] outputs: [Add__215:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Slice__204 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Cast__190:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_starts__255 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Slice__204 [Slice] inputs: [Cast__190:0 -> (4)], [const_starts__255 -> (1)], [const_ends__202 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Slice__204 for ONNX node: Slice__204 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Slice__204:0 for ONNX tensor: Slice__204:0 [07/23/2021-23:45:40] [V] [TRT] Slice__204 [Slice] outputs: [Slice__204:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Sub__209 [Sub] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__196:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__204:0 [07/23/2021-23:45:40] [V] [TRT] Sub__209 [Sub] inputs: [Slice__196:0 -> (1)], [Slice__204:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Sub__209 for ONNX node: Sub__209 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Sub__209:0 for ONNX tensor: Sub__209:0 [07/23/2021-23:45:40] [V] [TRT] Sub__209 [Sub] outputs: [Sub__209:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Div__212 [Div] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Sub__209:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Div__212 [Div] inputs: [Sub__209:0 -> (1)], [const_ends__202 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: const_ends__202_9 for ONNX initializer: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Registering layer: Div__212 for ONNX node: Div__212 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Div__212:0 for ONNX tensor: Div__212:0 [07/23/2021-23:45:40] [V] [TRT] Div__212 [Div] outputs: [Div__212:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Concat__216 [Concat] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Div__212:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Div__213:0 [07/23/2021-23:45:40] [V] [TRT] Concat__216 [Concat] inputs: [Div__212:0 -> (1)], [Div__213:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Concat__216 for ONNX node: Concat__216 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Concat__216:0 for ONNX tensor: Concat__216:0 [07/23/2021-23:45:40] [V] [TRT] Concat__216 [Concat] outputs: [Concat__216:0 -> (2)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Add__214 [Add] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Div__212:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__204:0 [07/23/2021-23:45:40] [V] [TRT] Add__214 [Add] inputs: [Div__212:0 -> (1)], [Slice__204:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Add__214 for ONNX node: Add__214 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Add__214:0 for ONNX tensor: Add__214:0 [07/23/2021-23:45:40] [V] [TRT] Add__214 [Add] outputs: [Add__214:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Concat__217 [Concat] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Add__214:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Add__215:0 [07/23/2021-23:45:40] [V] [TRT] Concat__217 [Concat] inputs: [Add__214:0 -> (1)], [Add__215:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Concat__217 for ONNX node: Concat__217 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Concat__217:0 for ONNX tensor: Concat__217:0 [07/23/2021-23:45:40] [V] [TRT] Concat__217 [Concat] outputs: [Concat__217:0 -> (2)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Slice__219 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Concat__216:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Concat__217:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose_const_slice_axes__218 [07/23/2021-23:45:40] [V] [TRT] Slice__219 [Slice] inputs: [StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose:0 -> (-1, 128, -1, -1)], [Concat__216:0 -> (2)], [Concat__217:0 -> (2)], [StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose_const_slice_axes__218 -> (2)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Slice__219 for ONNX node: Slice__219 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Slice__219:0 for ONNX tensor: Slice__219:0 [07/23/2021-23:45:40] [V] [TRT] Slice__219 [Slice] outputs: [Slice__219:0 -> (-1, -1, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_2/BiasAdd [Add] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__219:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_fold_opt__476 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_2/BiasAdd [Add] inputs: [Slice__219:0 -> (-1, -1, -1, -1)], [const_fold_opt__476 -> (1, 128, 1, 1)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: const_fold_opt__476 for ONNX initializer: const_fold_opt__476 [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_2/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_2/BiasAdd [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_2/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_2/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_2/BiasAdd [Add] outputs: [StatefulPartitionedCall/model/conv2d_transpose_2/BiasAdd:0 -> (-1, 128, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_2/Relu [Relu] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_2/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_2/Relu [Relu] inputs: [StatefulPartitionedCall/model/conv2d_transpose_2/BiasAdd:0 -> (-1, 128, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_2/Relu for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_2/Relu [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_2/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_2/Relu:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_2/Relu [Relu] outputs: [StatefulPartitionedCall/model/conv2d_transpose_2/Relu:0 -> (-1, 128, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose [ConvTranspose] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_2/Relu:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose [ConvTranspose] inputs: [StatefulPartitionedCall/model/conv2d_transpose_2/Relu:0 -> (-1, 128, -1, -1)], [StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose/ReadVariableOp:0 -> (128, 256, 3, 3)], [07/23/2021-23:45:40] [V] [TRT] Running deconvolution with: Padding mode: NOTSET Pre-padding: (0, 0) Post-padding: (0, 0) [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose [ConvTranspose] outputs: [StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose:0 -> (-1, 256, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Shape__407 [Shape] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose:0 [07/23/2021-23:45:40] [V] [TRT] Shape__407 [Shape] inputs: [StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose:0 -> (-1, 256, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Shape__407 for ONNX node: Shape__407 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Shape__407:0 for ONNX tensor: Shape__407:0 [07/23/2021-23:45:40] [V] [TRT] Shape__407 [Shape] outputs: [Shape__407:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Gather__410 [Gather] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Shape__407:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Const__463 [07/23/2021-23:45:40] [V] [TRT] Gather__410 [Gather] inputs: [Shape__407:0 -> (4)], [Const__463 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: Const__463_10 for ONNX initializer: Const__463 [07/23/2021-23:45:40] [V] [TRT] Using Gather axis: 0 [07/23/2021-23:45:40] [V] [TRT] Registering layer: Gather__410 for ONNX node: Gather__410 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Shape__253:0 for ONNX tensor: Shape__253:0 [07/23/2021-23:45:40] [V] [TRT] Gather__410 [Gather] outputs: [Shape__253:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Slice__262 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Shape__253:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__260 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Slice__262 [Slice] inputs: [Shape__253:0 -> (4)], [const_ends__202 -> (1)], [const_ends__260 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Slice__262 for ONNX node: Slice__262 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Slice__262:0 for ONNX tensor: Slice__262:0 [07/23/2021-23:45:40] [V] [TRT] Slice__262 [Slice] outputs: [Slice__262:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Slice__258 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Shape__253:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_starts__255 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Slice__258 [Slice] inputs: [Shape__253:0 -> (4)], [const_starts__255 -> (1)], [const_ends__202 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Slice__258 for ONNX node: Slice__258 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Slice__258:0 for ONNX tensor: Slice__258:0 [07/23/2021-23:45:40] [V] [TRT] Slice__258 [Slice] outputs: [Slice__258:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Shape__459 [Shape] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_2/Relu:0 [07/23/2021-23:45:40] [V] [TRT] Shape__459 [Shape] inputs: [StatefulPartitionedCall/model/conv2d_transpose_2/Relu:0 -> (-1, 128, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Shape__459 for ONNX node: Shape__459 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Shape__459:0 for ONNX tensor: Shape__459:0 [07/23/2021-23:45:40] [V] [TRT] Shape__459 [Shape] outputs: [Shape__459:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Gather__464 [Gather] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Shape__459:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Const__463 [07/23/2021-23:45:40] [V] [TRT] Gather__464 [Gather] inputs: [Shape__459:0 -> (4)], [Const__463 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: Const__463_11 for ONNX initializer: Const__463 [07/23/2021-23:45:40] [V] [TRT] Using Gather axis: 0 [07/23/2021-23:45:40] [V] [TRT] Registering layer: Gather__464 for ONNX node: Gather__464 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_3/Shape:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_3/Shape:0 [07/23/2021-23:45:40] [V] [TRT] Gather__464 [Gather] outputs: [StatefulPartitionedCall/model/conv2d_transpose_3/Shape:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_3/Shape__227 [Cast] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_3/Shape:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_3/Shape__227 [Cast] inputs: [StatefulPartitionedCall/model/conv2d_transpose_3/Shape:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Casting to type: int32 [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_3/Shape__227 for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_3/Shape__227 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_3/Shape__227:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_3/Shape__227:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_3/Shape__227 [Cast] outputs: [StatefulPartitionedCall/model/conv2d_transpose_3/Shape__227:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice_2 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_3/Shape__227:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__260 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice_2 [Slice] inputs: [StatefulPartitionedCall/model/conv2d_transpose_3/Shape__227:0 -> (4)], [const_ends__202 -> (1)], [const_ends__260 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice_2 for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice_2 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice_2:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice_2:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice_2 [Slice] outputs: [StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice_2:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice_1 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_3/Shape__227:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_starts__255 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice_1 [Slice] inputs: [StatefulPartitionedCall/model/conv2d_transpose_3/Shape__227:0 -> (4)], [const_starts__255 -> (1)], [const_ends__202 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice_1 for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice_1 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice_1:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice_1 [Slice] outputs: [StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice_1:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_3/Shape__227:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_starts__255 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice [Slice] inputs: [StatefulPartitionedCall/model/conv2d_transpose_3/Shape__227:0 -> (4)], [const_axes__235 -> (1)], [const_starts__255 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice [Slice] outputs: [StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_3/stack_Concat__251 [Concat] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice_1:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice_2:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_fold_opt__477 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_3/stack_Concat__251 [Concat] inputs: [StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice:0 -> (1)], [StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice_1:0 -> (1)], [StatefulPartitionedCall/model/conv2d_transpose_3/strided_slice_2:0 -> (1)], [const_fold_opt__477 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: const_fold_opt__477 for ONNX initializer: const_fold_opt__477 [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_3/stack_Concat__251 for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_3/stack_Concat__251 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_3/stack_Concat__251:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_3/stack_Concat__251:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_3/stack_Concat__251 [Concat] outputs: [StatefulPartitionedCall/model/conv2d_transpose_3/stack_Concat__251:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Cast__252 [Cast] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_3/stack_Concat__251:0 [07/23/2021-23:45:40] [V] [TRT] Cast__252 [Cast] inputs: [StatefulPartitionedCall/model/conv2d_transpose_3/stack_Concat__251:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Casting to type: int32 [07/23/2021-23:45:40] [V] [TRT] Registering layer: Cast__252 for ONNX node: Cast__252 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Cast__252:0 for ONNX tensor: Cast__252:0 [07/23/2021-23:45:40] [V] [TRT] Cast__252 [Cast] outputs: [Cast__252:0 -> (4)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Slice__270 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Cast__252:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__260 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Slice__270 [Slice] inputs: [Cast__252:0 -> (4)], [const_ends__202 -> (1)], [const_ends__260 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Slice__270 for ONNX node: Slice__270 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Slice__270:0 for ONNX tensor: Slice__270:0 [07/23/2021-23:45:40] [V] [TRT] Slice__270 [Slice] outputs: [Slice__270:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Sub__272 [Sub] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__262:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__270:0 [07/23/2021-23:45:40] [V] [TRT] Sub__272 [Sub] inputs: [Slice__262:0 -> (1)], [Slice__270:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Sub__272 for ONNX node: Sub__272 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Sub__272:0 for ONNX tensor: Sub__272:0 [07/23/2021-23:45:40] [V] [TRT] Sub__272 [Sub] outputs: [Sub__272:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Div__275 [Div] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Sub__272:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Div__275 [Div] inputs: [Sub__272:0 -> (1)], [const_ends__202 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: const_ends__202_12 for ONNX initializer: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Registering layer: Div__275 for ONNX node: Div__275 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Div__275:0 for ONNX tensor: Div__275:0 [07/23/2021-23:45:40] [V] [TRT] Div__275 [Div] outputs: [Div__275:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Add__277 [Add] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Div__275:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__270:0 [07/23/2021-23:45:40] [V] [TRT] Add__277 [Add] inputs: [Div__275:0 -> (1)], [Slice__270:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Add__277 for ONNX node: Add__277 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Add__277:0 for ONNX tensor: Add__277:0 [07/23/2021-23:45:40] [V] [TRT] Add__277 [Add] outputs: [Add__277:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Slice__266 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Cast__252:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_starts__255 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_axes__235 [07/23/2021-23:45:40] [V] [TRT] Slice__266 [Slice] inputs: [Cast__252:0 -> (4)], [const_starts__255 -> (1)], [const_ends__202 -> (1)], [const_axes__235 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Slice__266 for ONNX node: Slice__266 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Slice__266:0 for ONNX tensor: Slice__266:0 [07/23/2021-23:45:40] [V] [TRT] Slice__266 [Slice] outputs: [Slice__266:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Sub__271 [Sub] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__258:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__266:0 [07/23/2021-23:45:40] [V] [TRT] Sub__271 [Sub] inputs: [Slice__258:0 -> (1)], [Slice__266:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Sub__271 for ONNX node: Sub__271 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Sub__271:0 for ONNX tensor: Sub__271:0 [07/23/2021-23:45:40] [V] [TRT] Sub__271 [Sub] outputs: [Sub__271:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Div__274 [Div] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Sub__271:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Div__274 [Div] inputs: [Sub__271:0 -> (1)], [const_ends__202 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: const_ends__202_13 for ONNX initializer: const_ends__202 [07/23/2021-23:45:40] [V] [TRT] Registering layer: Div__274 for ONNX node: Div__274 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Div__274:0 for ONNX tensor: Div__274:0 [07/23/2021-23:45:40] [V] [TRT] Div__274 [Div] outputs: [Div__274:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Concat__278 [Concat] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Div__274:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Div__275:0 [07/23/2021-23:45:40] [V] [TRT] Concat__278 [Concat] inputs: [Div__274:0 -> (1)], [Div__275:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Concat__278 for ONNX node: Concat__278 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Concat__278:0 for ONNX tensor: Concat__278:0 [07/23/2021-23:45:40] [V] [TRT] Concat__278 [Concat] outputs: [Concat__278:0 -> (2)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Add__276 [Add] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Div__274:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__266:0 [07/23/2021-23:45:40] [V] [TRT] Add__276 [Add] inputs: [Div__274:0 -> (1)], [Slice__266:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Add__276 for ONNX node: Add__276 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Add__276:0 for ONNX tensor: Add__276:0 [07/23/2021-23:45:40] [V] [TRT] Add__276 [Add] outputs: [Add__276:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Concat__279 [Concat] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Add__276:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Add__277:0 [07/23/2021-23:45:40] [V] [TRT] Concat__279 [Concat] inputs: [Add__276:0 -> (1)], [Add__277:0 -> (1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Concat__279 for ONNX node: Concat__279 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Concat__279:0 for ONNX tensor: Concat__279:0 [07/23/2021-23:45:40] [V] [TRT] Concat__279 [Concat] outputs: [Concat__279:0 -> (2)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: Slice__281 [Slice] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Concat__278:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: Concat__279:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose_const_slice_axes__218 [07/23/2021-23:45:40] [V] [TRT] Slice__281 [Slice] inputs: [StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose:0 -> (-1, 256, -1, -1)], [Concat__278:0 -> (2)], [Concat__279:0 -> (2)], [StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose_const_slice_axes__218 -> (2)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: Slice__281 for ONNX node: Slice__281 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: Slice__281:0 for ONNX tensor: Slice__281:0 [07/23/2021-23:45:40] [V] [TRT] Slice__281 [Slice] outputs: [Slice__281:0 -> (-1, -1, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_3/BiasAdd [Add] [07/23/2021-23:45:40] [V] [TRT] Searching for input: Slice__281:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: const_fold_opt__480 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_3/BiasAdd [Add] inputs: [Slice__281:0 -> (-1, -1, -1, -1)], [const_fold_opt__480 -> (1, 256, 1, 1)], [07/23/2021-23:45:40] [V] [TRT] Registering constant layer: const_fold_opt__480 for ONNX initializer: const_fold_opt__480 [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_3/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_3/BiasAdd [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_3/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_3/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_3/BiasAdd [Add] outputs: [StatefulPartitionedCall/model/conv2d_transpose_3/BiasAdd:0 -> (-1, 256, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_transpose_3/Relu [Relu] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_3/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_3/Relu [Relu] inputs: [StatefulPartitionedCall/model/conv2d_transpose_3/BiasAdd:0 -> (-1, 256, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_transpose_3/Relu for ONNX node: StatefulPartitionedCall/model/conv2d_transpose_3/Relu [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_transpose_3/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_transpose_3/Relu:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_transpose_3/Relu [Relu] outputs: [StatefulPartitionedCall/model/conv2d_transpose_3/Relu:0 -> (-1, 256, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_4/BiasAdd [Conv] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_transpose_3/Relu:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_4/Conv2D/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_4/BiasAdd/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_transpose_3/Relu:0 -> (-1, 256, -1, -1)], [StatefulPartitionedCall/model/conv2d_4/Conv2D/ReadVariableOp:0 -> (256, 256, 3, 3)], [StatefulPartitionedCall/model/conv2d_4/BiasAdd/ReadVariableOp:0 -> (256)], [07/23/2021-23:45:40] [V] [TRT] Convolution input dimensions: (-1, 256, -1, -1) [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_4/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_4/BiasAdd [07/23/2021-23:45:40] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [07/23/2021-23:45:40] [V] [TRT] Convolution output dimensions: (-1, 256, -1, -1) [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_4/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_4/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_4/BiasAdd:0 -> (-1, 256, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_4/Relu [Relu] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_4/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/Relu [Relu] inputs: [StatefulPartitionedCall/model/conv2d_4/BiasAdd:0 -> (-1, 256, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_4/Relu for ONNX node: StatefulPartitionedCall/model/conv2d_4/Relu [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_4/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_4/Relu:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/Relu [Relu] outputs: [StatefulPartitionedCall/model/conv2d_4/Relu:0 -> (-1, 256, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/lambda/DepthToSpace [DepthToSpace] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_4/Relu:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/lambda/DepthToSpace [DepthToSpace] inputs: [StatefulPartitionedCall/model/conv2d_4/Relu:0 -> (-1, 256, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/lambda/DepthToSpace for ONNX node: StatefulPartitionedCall/model/lambda/DepthToSpace [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/lambda/DepthToSpace:0 for ONNX tensor: StatefulPartitionedCall/model/lambda/DepthToSpace:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/lambda/DepthToSpace [DepthToSpace] outputs: [StatefulPartitionedCall/model/lambda/DepthToSpace:0 -> (-1, -1, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_5/BiasAdd [Conv] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/lambda/DepthToSpace:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_5/Conv2D/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_5/BiasAdd/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/lambda/DepthToSpace:0 -> (-1, -1, -1, -1)], [StatefulPartitionedCall/model/conv2d_5/Conv2D/ReadVariableOp:0 -> (256, 64, 3, 3)], [StatefulPartitionedCall/model/conv2d_5/BiasAdd/ReadVariableOp:0 -> (256)], [07/23/2021-23:45:40] [V] [TRT] Convolution input dimensions: (-1, -1, -1, -1) [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_5/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_5/BiasAdd [07/23/2021-23:45:40] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [07/23/2021-23:45:40] [V] [TRT] Convolution output dimensions: (-1, 256, -1, -1) [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_5/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_5/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_5/BiasAdd:0 -> (-1, 256, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_5/Relu [Relu] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_5/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/Relu [Relu] inputs: [StatefulPartitionedCall/model/conv2d_5/BiasAdd:0 -> (-1, 256, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_5/Relu for ONNX node: StatefulPartitionedCall/model/conv2d_5/Relu [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_5/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_5/Relu:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/Relu [Relu] outputs: [StatefulPartitionedCall/model/conv2d_5/Relu:0 -> (-1, 256, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/lambda_1/DepthToSpace [DepthToSpace] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_5/Relu:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/lambda_1/DepthToSpace [DepthToSpace] inputs: [StatefulPartitionedCall/model/conv2d_5/Relu:0 -> (-1, 256, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/lambda_1/DepthToSpace for ONNX node: StatefulPartitionedCall/model/lambda_1/DepthToSpace [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/lambda_1/DepthToSpace:0 for ONNX tensor: StatefulPartitionedCall/model/lambda_1/DepthToSpace:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/lambda_1/DepthToSpace [DepthToSpace] outputs: [StatefulPartitionedCall/model/lambda_1/DepthToSpace:0 -> (-1, -1, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/output/BiasAdd [Conv] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/lambda_1/DepthToSpace:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/output/Conv2D/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/output/BiasAdd/ReadVariableOp:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/lambda_1/DepthToSpace:0 -> (-1, -1, -1, -1)], [StatefulPartitionedCall/model/output/Conv2D/ReadVariableOp:0 -> (3, 64, 3, 3)], [StatefulPartitionedCall/model/output/BiasAdd/ReadVariableOp:0 -> (3)], [07/23/2021-23:45:40] [V] [TRT] Convolution input dimensions: (-1, -1, -1, -1) [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/output/BiasAdd for ONNX node: StatefulPartitionedCall/model/output/BiasAdd [07/23/2021-23:45:40] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 3 [07/23/2021-23:45:40] [V] [TRT] Convolution output dimensions: (-1, 3, -1, -1) [07/23/2021-23:45:40] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/output/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/output/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/output/BiasAdd:0 -> (-1, 3, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Parsing node: StatefulPartitionedCall/model/output/BiasAdd__325 [Transpose] [07/23/2021-23:45:40] [V] [TRT] Searching for input: StatefulPartitionedCall/model/output/BiasAdd:0 [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd__325 [Transpose] inputs: [StatefulPartitionedCall/model/output/BiasAdd:0 -> (-1, 3, -1, -1)], [07/23/2021-23:45:40] [V] [TRT] Registering layer: StatefulPartitionedCall/model/output/BiasAdd__325 for ONNX node: StatefulPartitionedCall/model/output/BiasAdd__325 [07/23/2021-23:45:40] [V] [TRT] Registering tensor: output_14 for ONNX tensor: output [07/23/2021-23:45:40] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd__325 [Transpose] outputs: [output -> (-1, -1, -1, 3)], [07/23/2021-23:45:40] [V] [TRT] Marking output_14 as output: output [07/23/2021-23:45:40] [V] [TRT] Applying generic optimizations to the graph for inference. [07/23/2021-23:45:40] [V] [TRT] Original: 39 layers [07/23/2021-23:45:40] [V] [TRT] After dead-layer removal: 39 layers [07/23/2021-23:45:40] [V] [TRT] After Myelin optimization: 39 layers [07/23/2021-23:45:40] [V] [TRT] BinaryFusion: Fusing const_fold_opt__478 with StatefulPartitionedCall/model/conv2d_transpose/BiasAdd [07/23/2021-23:45:40] [V] [TRT] BinaryFusion: Fusing const_fold_opt__475 with StatefulPartitionedCall/model/conv2d_transpose_1/BiasAdd [07/23/2021-23:45:40] [V] [TRT] BinaryFusion: Fusing const_fold_opt__476 with StatefulPartitionedCall/model/conv2d_transpose_2/BiasAdd [07/23/2021-23:45:40] [V] [TRT] BinaryFusion: Fusing const_fold_opt__480 with StatefulPartitionedCall/model/conv2d_transpose_3/BiasAdd [07/23/2021-23:45:40] [V] [TRT] After scale fusion: 35 layers [07/23/2021-23:45:40] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/model/conv2d/BiasAdd with StatefulPartitionedCall/model/conv2d/Relu [07/23/2021-23:45:40] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/model/conv2d_1/BiasAdd with StatefulPartitionedCall/model/conv2d_1/Relu [07/23/2021-23:45:40] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/model/conv2d_2/BiasAdd with StatefulPartitionedCall/model/conv2d_2/Relu [07/23/2021-23:45:40] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/model/conv2d_3/BiasAdd with StatefulPartitionedCall/model/conv2d_3/Relu [07/23/2021-23:45:40] [V] [TRT] BinaryFusion: Fusing const_fold_opt__478 + StatefulPartitionedCall/model/conv2d_transpose/BiasAdd with StatefulPartitionedCall/model/conv2d_transpose/Relu [07/23/2021-23:45:40] [V] [TRT] BinaryFusion: Fusing const_fold_opt__475 + StatefulPartitionedCall/model/conv2d_transpose_1/BiasAdd with StatefulPartitionedCall/model/conv2d_transpose_1/Relu [07/23/2021-23:45:40] [V] [TRT] BinaryFusion: Fusing const_fold_opt__476 + StatefulPartitionedCall/model/conv2d_transpose_2/BiasAdd with StatefulPartitionedCall/model/conv2d_transpose_2/Relu [07/23/2021-23:45:40] [V] [TRT] BinaryFusion: Fusing const_fold_opt__480 + StatefulPartitionedCall/model/conv2d_transpose_3/BiasAdd with StatefulPartitionedCall/model/conv2d_transpose_3/Relu [07/23/2021-23:45:40] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/model/conv2d_4/BiasAdd with StatefulPartitionedCall/model/conv2d_4/Relu [07/23/2021-23:45:40] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/model/conv2d_5/BiasAdd with StatefulPartitionedCall/model/conv2d_5/Relu [07/23/2021-23:45:40] [V] [TRT] After vertical fusions: 25 layers [07/23/2021-23:45:40] [V] [TRT] After dupe layer removal: 25 layers [07/23/2021-23:45:40] [V] [TRT] After final dead-layer removal: 25 layers [07/23/2021-23:45:40] [V] [TRT] After tensor merging: 25 layers [07/23/2021-23:45:40] [V] [TRT] Replacing slice Slice__95 with copy from StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose:0 to Slice__95:0 [07/23/2021-23:45:40] [V] [TRT] Replacing slice Slice__157 with copy from StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose:0 to Slice__157:0 [07/23/2021-23:45:40] [V] [TRT] Replacing slice Slice__219 with copy from StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose:0 to Slice__219:0 [07/23/2021-23:45:40] [V] [TRT] Replacing slice Slice__281 with copy from StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose:0 to Slice__281:0 [07/23/2021-23:45:40] [V] [TRT] After concat removal: 25 layers [07/23/2021-23:45:40] [V] [TRT] Graph construction and optimization completed in 0.016346 seconds. [07/23/2021-23:45:41] [V] [TRT] Constructing optimization profile number 0 [1/1]. [07/23/2021-23:45:41] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:41] [V] [TRT] Tactic: 1002 time 0.027156 [07/23/2021-23:45:41] [V] [TRT] Tactic: 0 time 0.03022 [07/23/2021-23:45:41] [V] [TRT] Fastest Tactic: 1002 Time: 0.027156 [07/23/2021-23:45:41] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:41] [V] [TRT] Tactic: 1002 time 0.028036 [07/23/2021-23:45:41] [V] [TRT] Tactic: 0 time 0.029696 [07/23/2021-23:45:41] [V] [TRT] Fastest Tactic: 1002 Time: 0.028036 [07/23/2021-23:45:41] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:42] [V] [TRT] Tactic: 1002 time 0.027908 [07/23/2021-23:45:42] [V] [TRT] Tactic: 0 time 0.050304 [07/23/2021-23:45:42] [V] [TRT] Fastest Tactic: 1002 Time: 0.027908 [07/23/2021-23:45:42] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:42] [V] [TRT] Tactic: 1002 time 0.023552 [07/23/2021-23:45:42] [V] [TRT] Tactic: 0 time 0.025088 [07/23/2021-23:45:42] [V] [TRT] Fastest Tactic: 1002 Time: 0.023552 [07/23/2021-23:45:42] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:42] [V] [TRT] Tactic: 1002 time 0.03328 [07/23/2021-23:45:42] [V] [TRT] Tactic: 0 time 0.018952 [07/23/2021-23:45:42] [V] [TRT] Fastest Tactic: 0 Time: 0.018952 [07/23/2021-23:45:42] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:42] [V] [TRT] Tactic: 1002 time 0.024576 [07/23/2021-23:45:42] [V] [TRT] Tactic: 0 time 0.01998 [07/23/2021-23:45:42] [V] [TRT] Fastest Tactic: 0 Time: 0.01998 [07/23/2021-23:45:42] [V] [TRT] *************** Autotuning format combination: Float(1,3,768,196608) -> Float(1,256,65536,196608) *************** [07/23/2021-23:45:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd__9 (Shuffle) [07/23/2021-23:45:42] [V] [TRT] Tactic: 0 time 0.026496 [07/23/2021-23:45:42] [V] [TRT] Tactic: 1 time 0.083456 [07/23/2021-23:45:42] [V] [TRT] Fastest Tactic: 0 Time: 0.026496 [07/23/2021-23:45:42] [V] [TRT] *************** Autotuning format combination: Float(256,768,1,196608) -> Float(3,768,1,196608) *************** [07/23/2021-23:45:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd__9 (Shuffle) [07/23/2021-23:45:42] [V] [TRT] Tactic: 0 time 0.0512 [07/23/2021-23:45:42] [V] [TRT] Tactic: 1 time 0.02688 [07/23/2021-23:45:42] [V] [TRT] Fastest Tactic: 1 Time: 0.02688 [07/23/2021-23:45:42] [V] [TRT] *************** Autotuning format combination: Float(64,192,1:4,49152) -> Float(1,256,1:4,65536) *************** [07/23/2021-23:45:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd__9 (Shuffle) [07/23/2021-23:45:42] [V] [TRT] Tactic: 0 time 0.072448 [07/23/2021-23:45:42] [V] [TRT] Tactic: 1 time 0.192384 [07/23/2021-23:45:42] [V] [TRT] Fastest Tactic: 0 Time: 0.072448 [07/23/2021-23:45:42] [V] [TRT] *************** Autotuning format combination: Float(1,3,768:32,6144) -> Float(1,256,65536:32,65536) *************** [07/23/2021-23:45:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd__9 (Shuffle) [07/23/2021-23:45:42] [V] [TRT] Tactic: 0 time 1.83207 [07/23/2021-23:45:42] [V] [TRT] Tactic: 1 time 0.190736 [07/23/2021-23:45:42] [V] [TRT] Fastest Tactic: 1 Time: 0.190736 [07/23/2021-23:45:42] [V] [TRT] *************** Autotuning format combination: Half(1,3,768,196608) -> Half(1,256,65536,196608) *************** [07/23/2021-23:45:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd__9 (Shuffle) [07/23/2021-23:45:42] [V] [TRT] Tactic: 0 time 0.013608 [07/23/2021-23:45:42] [V] [TRT] Tactic: 1 time 0.0832 [07/23/2021-23:45:42] [V] [TRT] Fastest Tactic: 0 Time: 0.013608 [07/23/2021-23:45:42] [V] [TRT] *************** Autotuning format combination: Half(1,3,768:2,98304) -> Half(1,256,65536:2,131072) *************** [07/23/2021-23:45:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd__9 (Shuffle) [07/23/2021-23:45:42] [V] [TRT] Tactic: 0 time 0.020864 [07/23/2021-23:45:42] [V] [TRT] Tactic: 1 time 0.191616 [07/23/2021-23:45:42] [V] [TRT] Fastest Tactic: 0 Time: 0.020864 [07/23/2021-23:45:42] [V] [TRT] *************** Autotuning format combination: Half(32,96,1:8,24576) -> Half(1,256,1:8,65536) *************** [07/23/2021-23:45:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd__9 (Shuffle) [07/23/2021-23:45:42] [V] [TRT] Tactic: 0 time 0.062976 [07/23/2021-23:45:42] [V] [TRT] Tactic: 1 time 0.193796 [07/23/2021-23:45:42] [V] [TRT] Fastest Tactic: 0 Time: 0.062976 [07/23/2021-23:45:42] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:42] [V] [TRT] Tactic: 1002 time 0.080256 [07/23/2021-23:45:42] [V] [TRT] Tactic: 0 time 0.025216 [07/23/2021-23:45:42] [V] [TRT] Fastest Tactic: 0 Time: 0.025216 [07/23/2021-23:45:42] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:43] [V] [TRT] Tactic: 1002 time 0.191632 [07/23/2021-23:45:43] [V] [TRT] Tactic: 0 time 0.07296 [07/23/2021-23:45:43] [V] [TRT] Fastest Tactic: 0 Time: 0.07296 [07/23/2021-23:45:43] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:43] [V] [TRT] Tactic: 1002 time 0.023552 [07/23/2021-23:45:43] [V] [TRT] Tactic: 0 time 0.024832 [07/23/2021-23:45:43] [V] [TRT] Fastest Tactic: 1002 Time: 0.023552 [07/23/2021-23:45:43] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:43] [V] [TRT] Tactic: 1002 time 0.159104 [07/23/2021-23:45:43] [V] [TRT] Tactic: 0 time 0.021264 [07/23/2021-23:45:43] [V] [TRT] Fastest Tactic: 0 Time: 0.021264 [07/23/2021-23:45:43] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:43] [V] [TRT] Tactic: 1002 time 0.192384 [07/23/2021-23:45:43] [V] [TRT] Tactic: 0 time 0.020736 [07/23/2021-23:45:43] [V] [TRT] Fastest Tactic: 0 Time: 0.020736 [07/23/2021-23:45:43] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:43] [V] [TRT] Tactic: 1002 time 0.19264 [07/23/2021-23:45:43] [V] [TRT] Tactic: 0 time 0.029568 [07/23/2021-23:45:43] [V] [TRT] Fastest Tactic: 0 Time: 0.029568 [07/23/2021-23:45:43] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:43] [V] [TRT] Tactic: 1002 time 0.083584 [07/23/2021-23:45:43] [V] [TRT] Tactic: 0 time 0.025476 [07/23/2021-23:45:43] [V] [TRT] Fastest Tactic: 0 Time: 0.025476 [07/23/2021-23:45:43] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:43] [V] [TRT] Tactic: 1002 time 0.156416 [07/23/2021-23:45:43] [V] [TRT] Tactic: 0 time 0.073472 [07/23/2021-23:45:43] [V] [TRT] Fastest Tactic: 0 Time: 0.073472 [07/23/2021-23:45:43] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:43] [V] [TRT] Tactic: 1002 time 0.084096 [07/23/2021-23:45:43] [V] [TRT] Tactic: 0 time 0.019456 [07/23/2021-23:45:43] [V] [TRT] Fastest Tactic: 0 Time: 0.019456 [07/23/2021-23:45:43] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:43] [V] [TRT] Tactic: 1002 time 0.157568 [07/23/2021-23:45:43] [V] [TRT] Tactic: 0 time 0.023296 [07/23/2021-23:45:43] [V] [TRT] Fastest Tactic: 0 Time: 0.023296 [07/23/2021-23:45:43] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:43] [V] [TRT] Tactic: 1002 time 0.157184 [07/23/2021-23:45:43] [V] [TRT] Tactic: 0 time 0.024448 [07/23/2021-23:45:43] [V] [TRT] Fastest Tactic: 0 Time: 0.024448 [07/23/2021-23:45:43] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:43] [V] [TRT] Tactic: 1002 time 0.157568 [07/23/2021-23:45:43] [V] [TRT] Tactic: 0 time 0.072064 [07/23/2021-23:45:43] [V] [TRT] Fastest Tactic: 0 Time: 0.072064 [07/23/2021-23:45:43] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:43] [V] [TRT] Tactic: 1002 time 0.039168 [07/23/2021-23:45:44] [V] [TRT] Tactic: 0 time 0.029952 [07/23/2021-23:45:44] [V] [TRT] Fastest Tactic: 0 Time: 0.029952 [07/23/2021-23:45:44] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:44] [V] [TRT] Tactic: 1002 time 0.152576 [07/23/2021-23:45:44] [V] [TRT] Tactic: 0 time 0.030208 [07/23/2021-23:45:44] [V] [TRT] Fastest Tactic: 0 Time: 0.030208 [07/23/2021-23:45:44] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:44] [V] [TRT] Tactic: 1002 time 0.038144 [07/23/2021-23:45:44] [V] [TRT] Tactic: 0 time 0.023556 [07/23/2021-23:45:44] [V] [TRT] Fastest Tactic: 0 Time: 0.023556 [07/23/2021-23:45:44] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:44] [V] [TRT] Tactic: 1002 time 0.191744 [07/23/2021-23:45:44] [V] [TRT] Tactic: 0 time 0.02688 [07/23/2021-23:45:44] [V] [TRT] Fastest Tactic: 0 Time: 0.02688 [07/23/2021-23:45:44] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:44] [V] [TRT] Tactic: 1002 time 0.15744 [07/23/2021-23:45:44] [V] [TRT] Tactic: 0 time 0.032256 [07/23/2021-23:45:44] [V] [TRT] Fastest Tactic: 0 Time: 0.032256 [07/23/2021-23:45:44] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:44] [V] [TRT] Tactic: 1002 time 0.157568 [07/23/2021-23:45:44] [V] [TRT] Tactic: 0 time 0.074624 [07/23/2021-23:45:44] [V] [TRT] Fastest Tactic: 0 Time: 0.074624 [07/23/2021-23:45:44] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:44] [V] [TRT] Tactic: 1002 time 0.080128 [07/23/2021-23:45:44] [V] [TRT] Tactic: 0 time 0.098176 [07/23/2021-23:45:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.080128 [07/23/2021-23:45:44] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:44] [V] [TRT] Tactic: 1002 time 0.112128 [07/23/2021-23:45:44] [V] [TRT] Tactic: 0 time 0.049284 [07/23/2021-23:45:44] [V] [TRT] Fastest Tactic: 0 Time: 0.049284 [07/23/2021-23:45:44] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:44] [V] [TRT] Tactic: 1002 time 0.158336 [07/23/2021-23:45:44] [V] [TRT] Tactic: 0 time 0.095104 [07/23/2021-23:45:44] [V] [TRT] Fastest Tactic: 0 Time: 0.095104 [07/23/2021-23:45:44] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:44] [V] [TRT] Tactic: 1002 time 0.075008 [07/23/2021-23:45:44] [V] [TRT] Tactic: 0 time 0.089856 [07/23/2021-23:45:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.075008 [07/23/2021-23:45:44] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:44] [V] [TRT] Tactic: 1002 time 0.159104 [07/23/2021-23:45:44] [V] [TRT] Tactic: 0 time 0.108672 [07/23/2021-23:45:44] [V] [TRT] Fastest Tactic: 0 Time: 0.108672 [07/23/2021-23:45:44] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:44] [V] [TRT] Tactic: 1002 time 0.158976 [07/23/2021-23:45:44] [V] [TRT] Tactic: 0 time 0.063232 [07/23/2021-23:45:44] [V] [TRT] Fastest Tactic: 0 Time: 0.063232 [07/23/2021-23:45:44] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:45] [V] [TRT] Tactic: 1002 time 0.159104 [07/23/2021-23:45:45] [V] [TRT] Tactic: 0 time 0.093824 [07/23/2021-23:45:45] [V] [TRT] Fastest Tactic: 0 Time: 0.093824 [07/23/2021-23:45:45] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:45] [V] [TRT] Tactic: 1002 time 0.02432 [07/23/2021-23:45:45] [V] [TRT] Tactic: 0 time 0.027392 [07/23/2021-23:45:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.02432 [07/23/2021-23:45:45] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:45] [V] [TRT] Tactic: 1002 time 0.08064 [07/23/2021-23:45:45] [V] [TRT] Tactic: 0 time 0.021124 [07/23/2021-23:45:45] [V] [TRT] Fastest Tactic: 0 Time: 0.021124 [07/23/2021-23:45:45] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:45] [V] [TRT] Tactic: 1002 time 0.192128 [07/23/2021-23:45:45] [V] [TRT] Tactic: 0 time 0.067712 [07/23/2021-23:45:45] [V] [TRT] Fastest Tactic: 0 Time: 0.067712 [07/23/2021-23:45:45] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:45] [V] [TRT] Tactic: 1002 time 0.159232 [07/23/2021-23:45:45] [V] [TRT] Tactic: 0 time 0.018304 [07/23/2021-23:45:45] [V] [TRT] Fastest Tactic: 0 Time: 0.018304 [07/23/2021-23:45:45] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:45] [V] [TRT] Tactic: 1002 time 0.19328 [07/23/2021-23:45:45] [V] [TRT] Tactic: 0 time 0.01792 [07/23/2021-23:45:45] [V] [TRT] Fastest Tactic: 0 Time: 0.01792 [07/23/2021-23:45:45] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:45] [V] [TRT] Tactic: 1002 time 0.193024 [07/23/2021-23:45:45] [V] [TRT] Tactic: 0 time 0.023936 [07/23/2021-23:45:45] [V] [TRT] Fastest Tactic: 0 Time: 0.023936 [07/23/2021-23:45:45] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:45] [V] [TRT] Tactic: 1002 time 0.037124 [07/23/2021-23:45:45] [V] [TRT] Tactic: 0 time 0.022528 [07/23/2021-23:45:45] [V] [TRT] Fastest Tactic: 0 Time: 0.022528 [07/23/2021-23:45:45] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:45] [V] [TRT] Tactic: 1002 time 0.153216 [07/23/2021-23:45:45] [V] [TRT] Tactic: 0 time 0.022656 [07/23/2021-23:45:45] [V] [TRT] Fastest Tactic: 0 Time: 0.022656 [07/23/2021-23:45:45] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:45] [V] [TRT] Tactic: 1002 time 0.19136 [07/23/2021-23:45:45] [V] [TRT] Tactic: 0 time 0.069504 [07/23/2021-23:45:45] [V] [TRT] Fastest Tactic: 0 Time: 0.069504 [07/23/2021-23:45:45] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:45] [V] [TRT] Tactic: 1002 time 0.036488 [07/23/2021-23:45:45] [V] [TRT] Tactic: 0 time 0.015892 [07/23/2021-23:45:45] [V] [TRT] Fastest Tactic: 0 Time: 0.015892 [07/23/2021-23:45:45] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:45] [V] [TRT] Tactic: 1002 time 0.192532 [07/23/2021-23:45:45] [V] [TRT] Tactic: 0 time 0.022144 [07/23/2021-23:45:45] [V] [TRT] Fastest Tactic: 0 Time: 0.022144 [07/23/2021-23:45:45] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:46] [V] [TRT] Tactic: 1002 time 0.192512 [07/23/2021-23:45:46] [V] [TRT] Tactic: 0 time 0.025472 [07/23/2021-23:45:46] [V] [TRT] Fastest Tactic: 0 Time: 0.025472 [07/23/2021-23:45:46] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:46] [V] [TRT] Tactic: 1002 time 0.039424 [07/23/2021-23:45:46] [V] [TRT] Tactic: 0 time 0.020864 [07/23/2021-23:45:46] [V] [TRT] Fastest Tactic: 0 Time: 0.020864 [07/23/2021-23:45:46] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:46] [V] [TRT] Tactic: 1002 time 0.152576 [07/23/2021-23:45:46] [V] [TRT] Tactic: 0 time 0.022272 [07/23/2021-23:45:46] [V] [TRT] Fastest Tactic: 0 Time: 0.022272 [07/23/2021-23:45:46] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:46] [V] [TRT] Tactic: 1002 time 0.156928 [07/23/2021-23:45:46] [V] [TRT] Tactic: 0 time 0.070656 [07/23/2021-23:45:46] [V] [TRT] Fastest Tactic: 0 Time: 0.070656 [07/23/2021-23:45:46] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:46] [V] [TRT] Tactic: 1002 time 0.038784 [07/23/2021-23:45:46] [V] [TRT] Tactic: 0 time 0.017152 [07/23/2021-23:45:46] [V] [TRT] Fastest Tactic: 0 Time: 0.017152 [07/23/2021-23:45:46] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:46] [V] [TRT] Tactic: 1002 time 0.192384 [07/23/2021-23:45:46] [V] [TRT] Tactic: 0 time 0.020864 [07/23/2021-23:45:46] [V] [TRT] Fastest Tactic: 0 Time: 0.020864 [07/23/2021-23:45:46] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:46] [V] [TRT] Tactic: 1002 time 0.15808 [07/23/2021-23:45:46] [V] [TRT] Tactic: 0 time 0.068992 [07/23/2021-23:45:46] [V] [TRT] Fastest Tactic: 0 Time: 0.068992 [07/23/2021-23:45:46] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:46] [V] [TRT] Tactic: 1002 time 0.040704 [07/23/2021-23:45:46] [V] [TRT] Tactic: 0 time 0.029056 [07/23/2021-23:45:46] [V] [TRT] Fastest Tactic: 0 Time: 0.029056 [07/23/2021-23:45:46] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:46] [V] [TRT] Tactic: 1002 time 0.152704 [07/23/2021-23:45:46] [V] [TRT] Tactic: 0 time 0.03008 [07/23/2021-23:45:46] [V] [TRT] Fastest Tactic: 0 Time: 0.03008 [07/23/2021-23:45:46] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:46] [V] [TRT] Tactic: 1002 time 0.1568 [07/23/2021-23:45:46] [V] [TRT] Tactic: 0 time 0.076556 [07/23/2021-23:45:46] [V] [TRT] Fastest Tactic: 0 Time: 0.076556 [07/23/2021-23:45:46] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:46] [V] [TRT] Tactic: 1002 time 0.039296 [07/23/2021-23:45:46] [V] [TRT] Tactic: 0 time 0.022016 [07/23/2021-23:45:46] [V] [TRT] Fastest Tactic: 0 Time: 0.022016 [07/23/2021-23:45:46] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:47] [V] [TRT] Tactic: 1002 time 0.19252 [07/23/2021-23:45:47] [V] [TRT] Tactic: 0 time 0.023192 [07/23/2021-23:45:47] [V] [TRT] Fastest Tactic: 0 Time: 0.023192 [07/23/2021-23:45:47] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:47] [V] [TRT] Tactic: 1002 time 0.15808 [07/23/2021-23:45:47] [V] [TRT] Tactic: 0 time 0.031488 [07/23/2021-23:45:47] [V] [TRT] Fastest Tactic: 0 Time: 0.031488 [07/23/2021-23:45:47] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,196608) -> Float(1,256,65536,16777216) *************** [07/23/2021-23:45:47] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 [07/23/2021-23:45:47] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 [07/23/2021-23:45:47] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 [07/23/2021-23:45:47] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 [07/23/2021-23:45:47] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 [07/23/2021-23:45:47] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 [07/23/2021-23:45:47] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 [07/23/2021-23:45:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (FusedConvActConvolution) [07/23/2021-23:45:47] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CaskConvolution) [07/23/2021-23:45:47] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 [07/23/2021-23:45:47] [V] [TRT] Tactic: 4549827808004681195 time 1.10362 [07/23/2021-23:45:47] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 [07/23/2021-23:45:47] [V] [TRT] Tactic: 5779835512569528575 time 1.18478 [07/23/2021-23:45:47] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 [07/23/2021-23:45:47] [V] [TRT] Tactic: 6053873026024413720 time 1.33146 [07/23/2021-23:45:47] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 [07/23/2021-23:45:47] [V] [TRT] Tactic: 6767548733843469815 time 1.08482 [07/23/2021-23:45:47] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 [07/23/2021-23:45:47] [V] [TRT] Tactic: -6313876406580483184 time 1.22202 [07/23/2021-23:45:47] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 [07/23/2021-23:45:47] [V] [TRT] Tactic: -1123676555321336786 time 1.1945 [07/23/2021-23:45:47] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 [07/23/2021-23:45:47] [V] [TRT] Tactic: -701551393537224327 time 1.11578 [07/23/2021-23:45:47] [V] [TRT] Fastest Tactic: 6767548733843469815 Time: 1.08482 [07/23/2021-23:45:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CudaConvolution) [07/23/2021-23:45:48] [V] [TRT] Tactic: 0 time 5.3869 [07/23/2021-23:45:48] [V] [TRT] Tactic: 1 time 4.72 [07/23/2021-23:45:48] [V] [TRT] Tactic: 2 time 6.04749 [07/23/2021-23:45:48] [V] [TRT] Tactic: 5 time 9.91423 [07/23/2021-23:45:48] [V] [TRT] Tactic: 6 time 5.02438 [07/23/2021-23:45:48] [V] [TRT] Tactic: 56 time 5.37549 [07/23/2021-23:45:48] [V] [TRT] Tactic: 57 time 4.71334 [07/23/2021-23:45:48] [V] [TRT] Tactic: 58 time 6.04019 [07/23/2021-23:45:48] [V] [TRT] Tactic: 61 time 9.78483 [07/23/2021-23:45:49] [V] [TRT] Tactic: 62 time 5.024 [07/23/2021-23:45:49] [V] [TRT] Tactic: 112 time 5.38086 [07/23/2021-23:45:49] [V] [TRT] Tactic: 113 time 4.71616 [07/23/2021-23:45:49] [V] [TRT] Tactic: 114 time 6.03942 [07/23/2021-23:45:49] [V] [TRT] Tactic: 117 time 9.88849 [07/23/2021-23:45:49] [V] [TRT] Tactic: 118 time 5.02477 [07/23/2021-23:45:49] [V] [TRT] Fastest Tactic: 57 Time: 4.71334 [07/23/2021-23:45:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CudaDepthwiseConvolution) [07/23/2021-23:45:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CublasConvolution) [07/23/2021-23:45:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6767548733843469815 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 [07/23/2021-23:45:49] [V] [TRT] [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 [07/23/2021-23:45:49] [V] [TRT] *************** Autotuning format combination: Float(3,768,1,196608) -> Float(256,65536,1,16777216) *************** [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (FusedConvActConvolution) [07/23/2021-23:45:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CaskConvolution) [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] Tactic: 5778138195697110003 time 1.01031 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] Tactic: -3855385237722507464 time 1.024 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] Tactic: -2809379259463049391 time 1.07072 [07/23/2021-23:45:49] [V] [TRT] Fastest Tactic: 5778138195697110003 Time: 1.01031 [07/23/2021-23:45:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CudaConvolution) [07/23/2021-23:45:49] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CudaDepthwiseConvolution) [07/23/2021-23:45:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CublasConvolution) [07/23/2021-23:45:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5778138195697110003 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] *************** Autotuning format combination: Float(1,256,1:4,65536) -> Float(64,16384,1:4,4194304) *************** [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_indexed_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (FusedConvActConvolution) [07/23/2021-23:45:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CaskConvolution) [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] Tactic: 2860655430572478466 time 1.99437 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] Tactic: 4474630279712975759 time 4.50842 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] Tactic: 4479823862704990365 time 4.61888 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:49] [V] [TRT] Tactic: 4696204239951173149 time 2.20838 [07/23/2021-23:45:49] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:50] [V] [TRT] Tactic: 5778138195697110003 time 1.12026 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_indexed_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:45:50] [V] [TRT] Tactic: 6642501658177097719 time 1.58557 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:45:50] [V] [TRT] Tactic: 6670616668161295401 time 1.53946 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:50] [V] [TRT] Tactic: 7155825427510256858 time 1.0857 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:50] [V] [TRT] Tactic: 8918020581761223752 time 1.08493 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:45:50] [V] [TRT] Tactic: -8844488725130067278 time 1.5223 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:50] [V] [TRT] Tactic: -4756382386362004279 time 2.0329 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:50] [V] [TRT] Tactic: -3855385237722507464 time 1.15738 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:50] [V] [TRT] Tactic: -2809379259463049391 time 1.13512 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:50] [V] [TRT] Tactic: -504296718212024303 time 1.05523 [07/23/2021-23:45:50] [V] [TRT] Fastest Tactic: -504296718212024303 Time: 1.05523 [07/23/2021-23:45:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CudaConvolution) [07/23/2021-23:45:50] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CudaDepthwiseConvolution) [07/23/2021-23:45:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CublasConvolution) [07/23/2021-23:45:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -504296718212024303 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:50] [V] [TRT] [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_indexed_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:50] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:50] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,196608) -> Half(1,256,65536,16777216) *************** [07/23/2021-23:45:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (FusedConvActConvolution) [07/23/2021-23:45:50] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CaskConvolution) [07/23/2021-23:45:50] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CudaConvolution) [07/23/2021-23:45:50] [V] [TRT] Tactic: 0 time 2.95859 [07/23/2021-23:45:50] [V] [TRT] Tactic: 1 time 2.61941 [07/23/2021-23:45:50] [V] [TRT] Tactic: 2 time 3.69716 [07/23/2021-23:45:50] [V] [TRT] Tactic: 5 time 7.40121 [07/23/2021-23:45:50] [V] [TRT] Tactic: 6 time 4.76852 [07/23/2021-23:45:50] [V] [TRT] Tactic: 56 time 2.96333 [07/23/2021-23:45:50] [V] [TRT] Tactic: 58 time 3.68284 [07/23/2021-23:45:50] [V] [TRT] Tactic: 61 time 7.51656 [07/23/2021-23:45:51] [V] [TRT] Tactic: 62 time 4.76736 [07/23/2021-23:45:51] [V] [TRT] Fastest Tactic: 1 Time: 2.61941 [07/23/2021-23:45:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CudaDepthwiseConvolution) [07/23/2021-23:45:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CublasConvolution) [07/23/2021-23:45:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [07/23/2021-23:45:51] [V] [TRT] [07/23/2021-23:45:51] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,131072) -> Half(1,256,65536:2,8388608) *************** [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:45:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (FusedConvActConvolution) [07/23/2021-23:45:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CaskConvolution) [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:45:51] [V] [TRT] Tactic: 2195670545862694453 time 0.586392 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:45:51] [V] [TRT] Tactic: 3419182076704469245 time 0.524928 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:45:51] [V] [TRT] Tactic: 3891805945559659536 time 0.8864 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:45:51] [V] [TRT] Tactic: 5548126322150286555 time 0.521616 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:45:51] [V] [TRT] Tactic: 6057304366605292508 time 0.522496 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:45:51] [V] [TRT] Tactic: -7928611605886347652 time 0.89728 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:45:51] [V] [TRT] Tactic: -5172391392092686714 time 0.62336 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:45:51] [V] [TRT] Tactic: -4374269919094467161 time 0.56192 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:45:51] [V] [TRT] Tactic: -4083394051665370953 time 1.06907 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:45:51] [V] [TRT] Tactic: -1546027692247304867 time 0.909184 [07/23/2021-23:45:51] [V] [TRT] Fastest Tactic: 5548126322150286555 Time: 0.521616 [07/23/2021-23:45:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CudaConvolution) [07/23/2021-23:45:51] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CudaDepthwiseConvolution) [07/23/2021-23:45:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CublasConvolution) [07/23/2021-23:45:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5548126322150286555 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:45:51] [V] [TRT] [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:45:51] [V] [TRT] *************** Autotuning format combination: Half(1,256,1:4,65536) -> Half(32,8192,1:8,2097152) *************** [07/23/2021-23:45:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (FusedConvActConvolution) [07/23/2021-23:45:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CaskConvolution) [07/23/2021-23:45:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CudaConvolution) [07/23/2021-23:45:51] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CudaDepthwiseConvolution) [07/23/2021-23:45:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CublasConvolution) [07/23/2021-23:45:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:51] [V] [TRT] *************** Autotuning format combination: Half(1,256,1:8,65536) -> Float(1,256,65536,16777216) *************** [07/23/2021-23:45:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (FusedConvActConvolution) [07/23/2021-23:45:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CaskConvolution) [07/23/2021-23:45:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CudaConvolution) [07/23/2021-23:45:51] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CudaDepthwiseConvolution) [07/23/2021-23:45:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CublasConvolution) [07/23/2021-23:45:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:51] [V] [TRT] *************** Autotuning format combination: Half(1,256,1:8,65536) -> Half(32,8192,1:8,2097152) *************** [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:45:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (FusedConvActConvolution) [07/23/2021-23:45:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CaskConvolution) [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] Tactic: 254850674756030979 time 1.50592 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] Tactic: 1156328698016730421 time 1.19104 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:45:51] [V] [TRT] Tactic: 1584305878200231339 time 1.36717 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] Tactic: 1832046141070096030 time 2.46438 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] Tactic: 1838082074606840426 time 2.26281 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] Tactic: 1899296423087490472 time 3.2233 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:45:51] [V] [TRT] Tactic: 2338136297163812551 time 1.38996 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] Tactic: 2541579301352125276 time 1.76614 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] Tactic: 2657157263811141609 time 3.3751 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] Tactic: 2819719497590964443 time 2.29722 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:45:51] [V] [TRT] Tactic: 2835786846016979545 time 3.568 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:45:51] [V] [TRT] Tactic: 2968605903460894194 time 2.31718 [07/23/2021-23:45:51] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:52] [V] [TRT] Tactic: 2986078304285316765 time 1.78039 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:45:52] [V] [TRT] Tactic: 3362537467505018070 time 1.48698 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:52] [V] [TRT] Tactic: 3513075359009385578 time 1.3234 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:45:52] [V] [TRT] Tactic: 3546424067684403057 time 2.89537 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:45:52] [V] [TRT] Tactic: 3573559043797674382 time 2.5312 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:52] [V] [TRT] Tactic: 3704534001553878387 time 1.14063 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:45:52] [V] [TRT] Tactic: 4278315135102886928 time 2.27251 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:45:52] [V] [TRT] Tactic: 4750655167565104065 time 1.11411 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:52] [V] [TRT] Tactic: 4802447371470387646 time 1.93958 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:52] [V] [TRT] Tactic: 5059676457552313631 time 1.50925 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:52] [V] [TRT] Tactic: 5398999388616959893 time 1.56493 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:45:52] [V] [TRT] Tactic: 5579149726397848560 time 1.03426 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:45:52] [V] [TRT] Tactic: 5746691132547383910 time 2.2039 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:52] [V] [TRT] Tactic: 5770170567977052602 time 2.0297 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:45:52] [V] [TRT] Tactic: 5896806418498994339 time 1.32672 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:45:52] [V] [TRT] Tactic: 6034364043891107501 time 2.15091 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:45:52] [V] [TRT] Tactic: 6074229447555668232 time 3.18298 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:45:52] [V] [TRT] Tactic: 6176524653920166422 time 0.953344 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:45:52] [V] [TRT] Tactic: 6272216432116166416 time 1.44256 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:45:52] [V] [TRT] Tactic: 6377497238381488891 time 1.5145 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:45:52] [V] [TRT] Tactic: 6428823438254963239 time 1.13626 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:45:52] [V] [TRT] Tactic: 6446388116965632819 time 2.30707 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:45:52] [V] [TRT] Tactic: 6468794451065529747 time 2.37389 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:52] [V] [TRT] Tactic: 6642277870194067185 time 1.34886 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:45:52] [V] [TRT] Tactic: 6725284471687256210 time 1.16173 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:45:52] [V] [TRT] Tactic: 6859477213531075460 time 3.19066 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:45:52] [V] [TRT] Tactic: 7100752989500049598 time 1.17056 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:52] [V] [TRT] Tactic: 7216571380637776659 time 0.74688 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:45:52] [V] [TRT] Tactic: 7609923741161019135 time 2.30336 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:45:52] [V] [TRT] Tactic: 7667554089956651578 time 0.975744 [07/23/2021-23:45:52] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:45:53] [V] [TRT] Tactic: 7705739241028240201 time 3.35526 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:45:53] [V] [TRT] Tactic: 8040838497444300918 time 1.99898 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:45:53] [V] [TRT] Tactic: 8101703987960976805 time 3.3833 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:45:53] [V] [TRT] Tactic: 8170606396342855895 time 2.36851 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:45:53] [V] [TRT] Tactic: 8264928564315835356 time 1.04 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:53] [V] [TRT] Tactic: 8839784824303350101 time 0.69376 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:45:53] [V] [TRT] Tactic: -9217371357561775773 time 3.28064 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:53] [V] [TRT] Tactic: -9009272790678027912 time 2.07693 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:45:53] [V] [TRT] Tactic: -8949544755481315679 time 2.3017 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:45:53] [V] [TRT] Tactic: -8604374562669615024 time 3.32954 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:45:53] [V] [TRT] Tactic: -7938306756270351617 time 0.975616 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:45:53] [V] [TRT] Tactic: -7027328628217650515 time 0.870528 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:45:53] [V] [TRT] Tactic: -6840588038605932325 time 2.25267 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:45:53] [V] [TRT] Tactic: -6603588435230240365 time 0.987776 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:45:53] [V] [TRT] Tactic: -6356316196810535311 time 3.48634 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:53] [V] [TRT] Tactic: -6257787336162086472 time 1.18925 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:45:53] [V] [TRT] Tactic: -6063766379489217211 time 2.42176 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:45:53] [V] [TRT] Tactic: -6055152894973171263 time 0.937344 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:45:53] [V] [TRT] Tactic: -5634849406670564996 time 2.96947 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:53] [V] [TRT] Tactic: -5530886555766748586 time 1.90771 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:45:53] [V] [TRT] Tactic: -5421613452990385135 time 0.99392 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:45:53] [V] [TRT] Tactic: -5161596964442251102 time 2.19123 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:45:53] [V] [TRT] Tactic: -5127240325355316006 time 2.14746 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:45:53] [V] [TRT] Tactic: -4796511246675321840 time 2.29107 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:45:53] [V] [TRT] Tactic: -4706569565442112734 time 3.44243 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:45:53] [V] [TRT] Tactic: -4409144516525410768 time 1.49568 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:45:53] [V] [TRT] Tactic: -4379519430184503304 time 2.26637 [07/23/2021-23:45:53] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] Tactic: -4342782565153442362 time 0.974208 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] Tactic: -4191836638128696671 time 1.60064 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] Tactic: -4152066959007262150 time 1.31661 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] Tactic: -4021926646879732549 time 2.28454 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] Tactic: -3987638434926559037 time 2.29517 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] Tactic: -3939749857557624176 time 1.4665 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] Tactic: -3905653247016903130 time 1.65773 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] Tactic: -3895429239811098010 time 2.1824 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] Tactic: -3864869056275745423 time 1.97274 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] Tactic: -3601464762214218301 time 3.1511 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] Tactic: -3412636942650049698 time 1.62598 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] Tactic: -3058330359340425555 time 2.18893 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:45:54] [V] [TRT] Tactic: -2893013346565417259 time 0.953728 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] Tactic: -2816084650627734155 time 2.07245 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] Tactic: -2559894581585337900 time 1.50285 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] Tactic: -2241736083352441442 time 0.73728 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] Tactic: -1985778916402815946 time 2.02266 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:45:54] [V] [TRT] Tactic: -1979709471637578040 time 1.0528 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] Tactic: -1824906597022852312 time 0.980736 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:45:54] [V] [TRT] Tactic: -1727693334586194183 time 0.928512 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:45:54] [V] [TRT] Tactic: -1657270965825641606 time 0.9344 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] Tactic: -1500496213132463076 time 2.41536 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:45:54] [V] [TRT] Tactic: -1194193093145321861 time 1.89619 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] Tactic: -1099247066487349374 time 3.39738 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] Tactic: -705524612929044822 time 0.988672 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] Tactic: -680956411637736772 time 1.53894 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:45:54] [V] [TRT] Tactic: -504245585588397229 time 2.37286 [07/23/2021-23:45:54] [V] [TRT] Fastest Tactic: 8839784824303350101 Time: 0.69376 [07/23/2021-23:45:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CudaConvolution) [07/23/2021-23:45:54] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CudaDepthwiseConvolution) [07/23/2021-23:45:54] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (CublasConvolution) [07/23/2021-23:45:54] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:45:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8839784824303350101 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:45:54] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:45:54] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:54] [V] [TRT] Tactic: 1002 time 1.98016 [07/23/2021-23:45:55] [V] [TRT] Tactic: 0 time 4.95488 [07/23/2021-23:45:55] [V] [TRT] Fastest Tactic: 1002 Time: 1.98016 [07/23/2021-23:45:55] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:55] [V] [TRT] Tactic: 1002 time 2.06195 [07/23/2021-23:45:55] [V] [TRT] Tactic: 0 time 4.9746 [07/23/2021-23:45:55] [V] [TRT] Fastest Tactic: 1002 Time: 2.06195 [07/23/2021-23:45:55] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:55] [V] [TRT] Tactic: 1002 time 1.56173 [07/23/2021-23:45:55] [V] [TRT] Tactic: 0 time 1.79955 [07/23/2021-23:45:55] [V] [TRT] Fastest Tactic: 1002 Time: 1.56173 [07/23/2021-23:45:55] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:55] [V] [TRT] Tactic: 1002 time 2.15437 [07/23/2021-23:45:55] [V] [TRT] Tactic: 0 time 1.31917 [07/23/2021-23:45:55] [V] [TRT] Fastest Tactic: 0 Time: 1.31917 [07/23/2021-23:45:55] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:55] [V] [TRT] Tactic: 1002 time 1.66464 [07/23/2021-23:45:55] [V] [TRT] Tactic: 0 time 1.38637 [07/23/2021-23:45:55] [V] [TRT] Fastest Tactic: 0 Time: 1.38637 [07/23/2021-23:45:55] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:55] [V] [TRT] Tactic: 1002 time 2.00576 [07/23/2021-23:45:56] [V] [TRT] Tactic: 0 time 12.2327 [07/23/2021-23:45:56] [V] [TRT] Fastest Tactic: 1002 Time: 2.00576 [07/23/2021-23:45:56] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:56] [V] [TRT] Tactic: 1002 time 2.384 [07/23/2021-23:45:56] [V] [TRT] Tactic: 0 time 1.78816 [07/23/2021-23:45:56] [V] [TRT] Fastest Tactic: 0 Time: 1.78816 [07/23/2021-23:45:56] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:56] [V] [TRT] Tactic: 1002 time 1.56762 [07/23/2021-23:45:56] [V] [TRT] Tactic: 0 time 11.0986 [07/23/2021-23:45:56] [V] [TRT] Fastest Tactic: 1002 Time: 1.56762 [07/23/2021-23:45:56] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:56] [V] [TRT] Tactic: 1002 time 2.58931 [07/23/2021-23:45:56] [V] [TRT] Tactic: 0 time 12.229 [07/23/2021-23:45:56] [V] [TRT] Fastest Tactic: 1002 Time: 2.58931 [07/23/2021-23:45:56] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:56] [V] [TRT] Tactic: 1002 time 2.25651 [07/23/2021-23:45:56] [V] [TRT] Tactic: 0 time 1.28244 [07/23/2021-23:45:56] [V] [TRT] Fastest Tactic: 0 Time: 1.28244 [07/23/2021-23:45:56] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:57] [V] [TRT] Tactic: 1002 time 2.08794 [07/23/2021-23:45:57] [V] [TRT] Tactic: 0 time 12.2079 [07/23/2021-23:45:57] [V] [TRT] Fastest Tactic: 1002 Time: 2.08794 [07/23/2021-23:45:57] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:57] [V] [TRT] Tactic: 1002 time 2.3863 [07/23/2021-23:45:57] [V] [TRT] Tactic: 0 time 1.78675 [07/23/2021-23:45:57] [V] [TRT] Fastest Tactic: 0 Time: 1.78675 [07/23/2021-23:45:57] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:57] [V] [TRT] Tactic: 1002 time 1.70624 [07/23/2021-23:45:57] [V] [TRT] Tactic: 0 time 11.1082 [07/23/2021-23:45:57] [V] [TRT] Fastest Tactic: 1002 Time: 1.70624 [07/23/2021-23:45:57] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:57] [V] [TRT] Tactic: 1002 time 2.58022 [07/23/2021-23:45:58] [V] [TRT] Tactic: 0 time 12.3156 [07/23/2021-23:45:58] [V] [TRT] Fastest Tactic: 1002 Time: 2.58022 [07/23/2021-23:45:58] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:58] [V] [TRT] Tactic: 1002 time 2.25318 [07/23/2021-23:45:58] [V] [TRT] Tactic: 0 time 1.30944 [07/23/2021-23:45:58] [V] [TRT] Fastest Tactic: 0 Time: 1.30944 [07/23/2021-23:45:58] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:58] [V] [TRT] Tactic: 1002 time 1.63379 [07/23/2021-23:45:58] [V] [TRT] Tactic: 0 time 2.13952 [07/23/2021-23:45:58] [V] [TRT] Fastest Tactic: 1002 Time: 1.63379 [07/23/2021-23:45:58] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:58] [V] [TRT] Tactic: 1002 time 1.59923 [07/23/2021-23:45:58] [V] [TRT] Tactic: 0 time 2.17306 [07/23/2021-23:45:58] [V] [TRT] Fastest Tactic: 1002 Time: 1.59923 [07/23/2021-23:45:58] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:58] [V] [TRT] Tactic: 1002 time 1.84666 [07/23/2021-23:45:58] [V] [TRT] Tactic: 0 time 2.08141 [07/23/2021-23:45:58] [V] [TRT] Fastest Tactic: 1002 Time: 1.84666 [07/23/2021-23:45:58] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:58] [V] [TRT] Tactic: 1002 time 2.15744 [07/23/2021-23:45:58] [V] [TRT] Tactic: 0 time 0.927744 [07/23/2021-23:45:58] [V] [TRT] Fastest Tactic: 0 Time: 0.927744 [07/23/2021-23:45:58] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:58] [V] [TRT] Tactic: 1002 time 1.58554 [07/23/2021-23:45:59] [V] [TRT] Tactic: 0 time 0.963328 [07/23/2021-23:45:59] [V] [TRT] Fastest Tactic: 0 Time: 0.963328 [07/23/2021-23:45:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:59] [V] [TRT] Tactic: 1002 time 2.56013 [07/23/2021-23:45:59] [V] [TRT] Tactic: 0 time 1.3504 [07/23/2021-23:45:59] [V] [TRT] Fastest Tactic: 0 Time: 1.3504 [07/23/2021-23:45:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:59] [V] [TRT] Tactic: 1002 time 1.68653 [07/23/2021-23:45:59] [V] [TRT] Tactic: 0 time 2.25434 [07/23/2021-23:45:59] [V] [TRT] Fastest Tactic: 1002 Time: 1.68653 [07/23/2021-23:45:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:59] [V] [TRT] Tactic: 1002 time 1.68602 [07/23/2021-23:45:59] [V] [TRT] Tactic: 0 time 2.3063 [07/23/2021-23:45:59] [V] [TRT] Fastest Tactic: 1002 Time: 1.68602 [07/23/2021-23:45:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:59] [V] [TRT] Tactic: 1002 time 2.46746 [07/23/2021-23:45:59] [V] [TRT] Tactic: 0 time 0.886656 [07/23/2021-23:45:59] [V] [TRT] Fastest Tactic: 0 Time: 0.886656 [07/23/2021-23:45:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:59] [V] [TRT] Tactic: 1002 time 1.52986 [07/23/2021-23:45:59] [V] [TRT] Tactic: 0 time 0.968072 [07/23/2021-23:45:59] [V] [TRT] Fastest Tactic: 0 Time: 0.968072 [07/23/2021-23:45:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:45:59] [V] [TRT] Tactic: 1002 time 1.75219 [07/23/2021-23:45:59] [V] [TRT] Tactic: 0 time 1.40032 [07/23/2021-23:45:59] [V] [TRT] Fastest Tactic: 0 Time: 1.40032 [07/23/2021-23:45:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:00] [V] [TRT] Tactic: 1002 time 2.42611 [07/23/2021-23:46:00] [V] [TRT] Tactic: 0 time 1.33595 [07/23/2021-23:46:00] [V] [TRT] Fastest Tactic: 0 Time: 1.33595 [07/23/2021-23:46:00] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:00] [V] [TRT] Tactic: 1002 time 2.42613 [07/23/2021-23:46:00] [V] [TRT] Tactic: 0 time 1.3567 [07/23/2021-23:46:00] [V] [TRT] Fastest Tactic: 0 Time: 1.3567 [07/23/2021-23:46:00] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:00] [V] [TRT] Tactic: 1002 time 1.56852 [07/23/2021-23:46:00] [V] [TRT] Tactic: 0 time 0.937728 [07/23/2021-23:46:00] [V] [TRT] Fastest Tactic: 0 Time: 0.937728 [07/23/2021-23:46:00] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:00] [V] [TRT] Tactic: 1002 time 2.21978 [07/23/2021-23:46:00] [V] [TRT] Tactic: 0 time 0.93584 [07/23/2021-23:46:00] [V] [TRT] Fastest Tactic: 0 Time: 0.93584 [07/23/2021-23:46:00] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,16777216) -> Float(1,256,65536,8388608) *************** [07/23/2021-23:46:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 [07/23/2021-23:46:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 [07/23/2021-23:46:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 [07/23/2021-23:46:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 [07/23/2021-23:46:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 [07/23/2021-23:46:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 [07/23/2021-23:46:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 [07/23/2021-23:46:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (FusedConvActConvolution) [07/23/2021-23:46:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CaskConvolution) [07/23/2021-23:46:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 [07/23/2021-23:46:00] [V] [TRT] Tactic: 4549827808004681195 time 15.851 [07/23/2021-23:46:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 [07/23/2021-23:46:01] [V] [TRT] Tactic: 5779835512569528575 time 14.2926 [07/23/2021-23:46:01] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 [07/23/2021-23:46:01] [V] [TRT] Tactic: 6053873026024413720 time 14.395 [07/23/2021-23:46:01] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 [07/23/2021-23:46:01] [V] [TRT] Tactic: 6767548733843469815 time 15.3802 [07/23/2021-23:46:01] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 [07/23/2021-23:46:01] [V] [TRT] Tactic: -6313876406580483184 time 17.5437 [07/23/2021-23:46:01] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 [07/23/2021-23:46:02] [V] [TRT] Tactic: -1123676555321336786 time 14.4952 [07/23/2021-23:46:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 [07/23/2021-23:46:02] [V] [TRT] Tactic: -701551393537224327 time 16.2967 [07/23/2021-23:46:02] [V] [TRT] Fastest Tactic: 5779835512569528575 Time: 14.2926 [07/23/2021-23:46:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CudaConvolution) [07/23/2021-23:46:02] [V] [TRT] Tactic: 0 time 21.4819 [07/23/2021-23:46:02] [V] [TRT] Tactic: 1 time 8.20339 [07/23/2021-23:46:03] [V] [TRT] Tactic: 2 time 29.1739 [07/23/2021-23:46:03] [V] [TRT] Tactic: 5 time 27.2352 [07/23/2021-23:46:04] [V] [TRT] Tactic: 6 time 10.5024 [07/23/2021-23:46:04] [V] [TRT] Tactic: 56 time 21.4516 [07/23/2021-23:46:04] [V] [TRT] Tactic: 57 time 8.2441 [07/23/2021-23:46:05] [V] [TRT] Tactic: 58 time 29.0468 [07/23/2021-23:46:05] [V] [TRT] Tactic: 61 time 27.2953 [07/23/2021-23:46:05] [V] [TRT] Tactic: 62 time 10.5222 [07/23/2021-23:46:06] [V] [TRT] Tactic: 112 time 21.5066 [07/23/2021-23:46:06] [V] [TRT] Tactic: 113 time 19.029 [07/23/2021-23:46:06] [V] [TRT] Tactic: 114 time 29.0848 [07/23/2021-23:46:07] [V] [TRT] Tactic: 117 time 27.3089 [07/23/2021-23:46:07] [V] [TRT] Tactic: 118 time 10.5469 [07/23/2021-23:46:07] [V] [TRT] Fastest Tactic: 1 Time: 8.20339 [07/23/2021-23:46:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CublasConvolution) [07/23/2021-23:46:07] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [07/23/2021-23:46:07] [V] [TRT] [07/23/2021-23:46:07] [V] [TRT] *************** Autotuning format combination: Float(256,65536,1,16777216) -> Float(128,32768,1,8388608) *************** [07/23/2021-23:46:07] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:07] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:07] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:07] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:07] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:07] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:07] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:07] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:07] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:07] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:07] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (FusedConvActConvolution) [07/23/2021-23:46:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CaskConvolution) [07/23/2021-23:46:07] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:07] [V] [TRT] Tactic: 2860655430572478466 time 15.3879 [07/23/2021-23:46:07] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:08] [V] [TRT] Tactic: 4474630279712975759 time 16.8111 [07/23/2021-23:46:08] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:08] [V] [TRT] Tactic: 4479823862704990365 time 16.7988 [07/23/2021-23:46:08] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:08] [V] [TRT] Tactic: 4696204239951173149 time 15.616 [07/23/2021-23:46:08] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:08] [V] [TRT] Tactic: 5778138195697110003 time 14.5741 [07/23/2021-23:46:08] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:09] [V] [TRT] Tactic: 7155825427510256858 time 14.3396 [07/23/2021-23:46:09] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:09] [V] [TRT] Tactic: 8918020581761223752 time 14.2807 [07/23/2021-23:46:09] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:09] [V] [TRT] Tactic: -4756382386362004279 time 15.4642 [07/23/2021-23:46:09] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:09] [V] [TRT] Tactic: -3855385237722507464 time 14.6007 [07/23/2021-23:46:09] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] Tactic: -2809379259463049391 time 14.8675 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] Tactic: -504296718212024303 time 14.2223 [07/23/2021-23:46:10] [V] [TRT] Fastest Tactic: -504296718212024303 Time: 14.2223 [07/23/2021-23:46:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CudaConvolution) [07/23/2021-23:46:10] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CublasConvolution) [07/23/2021-23:46:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -504296718212024303 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] *************** Autotuning format combination: Float(64,16384,1:4,4194304) -> Float(32,8192,1:4,2097152) *************** [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_indexed_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (FusedConvActConvolution) [07/23/2021-23:46:10] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CaskConvolution) [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:10] [V] [TRT] Tactic: 2860655430572478466 time 15.546 [07/23/2021-23:46:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:11] [V] [TRT] Tactic: 4474630279712975759 time 16.865 [07/23/2021-23:46:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:11] [V] [TRT] Tactic: 4479823862704990365 time 16.8073 [07/23/2021-23:46:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:11] [V] [TRT] Tactic: 4696204239951173149 time 15.6838 [07/23/2021-23:46:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:11] [V] [TRT] Tactic: 5778138195697110003 time 14.4925 [07/23/2021-23:46:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_indexed_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:11] [V] [TRT] Tactic: 6642501658177097719 time 5.51526 [07/23/2021-23:46:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:12] [V] [TRT] Tactic: 6670616668161295401 time 5.41876 [07/23/2021-23:46:12] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:12] [V] [TRT] Tactic: 7155825427510256858 time 14.1623 [07/23/2021-23:46:12] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:12] [V] [TRT] Tactic: 8918020581761223752 time 14.4387 [07/23/2021-23:46:12] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:12] [V] [TRT] Tactic: -8844488725130067278 time 5.04858 [07/23/2021-23:46:12] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:12] [V] [TRT] Tactic: -4756382386362004279 time 15.4163 [07/23/2021-23:46:12] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:13] [V] [TRT] Tactic: -3855385237722507464 time 14.7049 [07/23/2021-23:46:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:13] [V] [TRT] Tactic: -2809379259463049391 time 14.9231 [07/23/2021-23:46:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:13] [V] [TRT] Tactic: -504296718212024303 time 14.3567 [07/23/2021-23:46:13] [V] [TRT] Fastest Tactic: -8844488725130067278 Time: 5.04858 [07/23/2021-23:46:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CudaConvolution) [07/23/2021-23:46:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CublasConvolution) [07/23/2021-23:46:13] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8844488725130067278 [07/23/2021-23:46:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:13] [V] [TRT] [07/23/2021-23:46:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_indexed_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:13] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,16777216) -> Half(1,256,65536,8388608) *************** [07/23/2021-23:46:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (FusedConvActConvolution) [07/23/2021-23:46:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CaskConvolution) [07/23/2021-23:46:13] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CudaConvolution) [07/23/2021-23:46:14] [V] [TRT] Tactic: 0 time 21.227 [07/23/2021-23:46:14] [V] [TRT] Tactic: 1 time 18.6461 [07/23/2021-23:46:14] [V] [TRT] Tactic: 2 time 24.1143 [07/23/2021-23:46:15] [V] [TRT] Tactic: 5 time 25.6371 [07/23/2021-23:46:15] [V] [TRT] Tactic: 6 time 11.7812 [07/23/2021-23:46:15] [V] [TRT] Tactic: 56 time 21.3836 [07/23/2021-23:46:16] [V] [TRT] Tactic: 58 time 24.4764 [07/23/2021-23:46:16] [V] [TRT] Tactic: 61 time 25.6599 [07/23/2021-23:46:16] [V] [TRT] Tactic: 62 time 11.8309 [07/23/2021-23:46:16] [V] [TRT] Fastest Tactic: 6 Time: 11.7812 [07/23/2021-23:46:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CublasConvolution) [07/23/2021-23:46:16] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [07/23/2021-23:46:16] [V] [TRT] [07/23/2021-23:46:16] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,8388608) -> Half(1,256,65536:2,4194304) *************** [07/23/2021-23:46:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:46:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:46:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:46:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:46:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:46:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:46:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:46:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:46:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:46:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:46:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (FusedConvActConvolution) [07/23/2021-23:46:16] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CaskConvolution) [07/23/2021-23:46:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:46:17] [V] [TRT] Tactic: 2195670545862694453 time 9.29357 [07/23/2021-23:46:17] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:46:17] [V] [TRT] Tactic: 3419182076704469245 time 8.97114 [07/23/2021-23:46:17] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:46:17] [V] [TRT] Tactic: 3891805945559659536 time 8.60877 [07/23/2021-23:46:17] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:46:17] [V] [TRT] Tactic: 5548126322150286555 time 8.80576 [07/23/2021-23:46:17] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:46:17] [V] [TRT] Tactic: 6057304366605292508 time 8.73562 [07/23/2021-23:46:17] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:46:17] [V] [TRT] Tactic: -7928611605886347652 time 8.72038 [07/23/2021-23:46:17] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:46:17] [V] [TRT] Tactic: -5172391392092686714 time 9.40147 [07/23/2021-23:46:17] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:46:18] [V] [TRT] Tactic: -4374269919094467161 time 9.40608 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:46:18] [V] [TRT] Tactic: -4083394051665370953 time 4.8791 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:46:18] [V] [TRT] Tactic: -1546027692247304867 time 8.58421 [07/23/2021-23:46:18] [V] [TRT] Fastest Tactic: -4083394051665370953 Time: 4.8791 [07/23/2021-23:46:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CudaConvolution) [07/23/2021-23:46:18] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CublasConvolution) [07/23/2021-23:46:18] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4083394051665370953 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:46:18] [V] [TRT] [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:46:18] [V] [TRT] *************** Autotuning format combination: Half(32,8192,1:8,2097152) -> Float(1,256,65536,8388608) *************** [07/23/2021-23:46:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (FusedConvActConvolution) [07/23/2021-23:46:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CaskConvolution) [07/23/2021-23:46:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CudaConvolution) [07/23/2021-23:46:18] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CublasConvolution) [07/23/2021-23:46:18] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:18] [V] [TRT] *************** Autotuning format combination: Half(32,8192,1:8,2097152) -> Half(16,4096,1:8,1048576) *************** [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (FusedConvActConvolution) [07/23/2021-23:46:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CaskConvolution) [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] Tactic: 254850674756030979 time 2.40463 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] Tactic: 1156328698016730421 time 2.27213 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:18] [V] [TRT] Tactic: 1584305878200231339 time 2.6048 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] Tactic: 1832046141070096030 time 2.65498 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] Tactic: 1838082074606840426 time 2.74803 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] Tactic: 1899296423087490472 time 3.0967 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:18] [V] [TRT] Tactic: 2338136297163812551 time 2.4439 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] Tactic: 2541579301352125276 time 2.52339 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:46:18] [V] [TRT] Tactic: 2657157263811141609 time 2.91034 [07/23/2021-23:46:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:19] [V] [TRT] Tactic: 2819719497590964443 time 2.78926 [07/23/2021-23:46:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:19] [V] [TRT] Tactic: 2835786846016979545 time 6.02701 [07/23/2021-23:46:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:19] [V] [TRT] Tactic: 2968605903460894194 time 2.53939 [07/23/2021-23:46:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:19] [V] [TRT] Tactic: 2986078304285316765 time 2.69491 [07/23/2021-23:46:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:19] [V] [TRT] Tactic: 3362537467505018070 time 2.34344 [07/23/2021-23:46:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:19] [V] [TRT] Tactic: 3513075359009385578 time 2.44058 [07/23/2021-23:46:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:19] [V] [TRT] Tactic: 3546424067684403057 time 5.936 [07/23/2021-23:46:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:19] [V] [TRT] Tactic: 3573559043797674382 time 2.54464 [07/23/2021-23:46:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:19] [V] [TRT] Tactic: 3704534001553878387 time 2.4201 [07/23/2021-23:46:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:19] [V] [TRT] Tactic: 4278315135102886928 time 2.92211 [07/23/2021-23:46:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:19] [V] [TRT] Tactic: 4750655167565104065 time 2.86797 [07/23/2021-23:46:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:19] [V] [TRT] Tactic: 4802447371470387646 time 3.28896 [07/23/2021-23:46:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:19] [V] [TRT] Tactic: 5059676457552313631 time 2.4201 [07/23/2021-23:46:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:19] [V] [TRT] Tactic: 5398999388616959893 time 2.54285 [07/23/2021-23:46:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:19] [V] [TRT] Tactic: 5579149726397848560 time 2.60237 [07/23/2021-23:46:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:19] [V] [TRT] Tactic: 5746691132547383910 time 2.73971 [07/23/2021-23:46:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:19] [V] [TRT] Tactic: 5770170567977052602 time 3.2361 [07/23/2021-23:46:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:20] [V] [TRT] Tactic: 5896806418498994339 time 4.33523 [07/23/2021-23:46:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:20] [V] [TRT] Tactic: 6034364043891107501 time 2.67981 [07/23/2021-23:46:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:46:20] [V] [TRT] Tactic: 6074229447555668232 time 3.17159 [07/23/2021-23:46:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:20] [V] [TRT] Tactic: 6176524653920166422 time 3.1543 [07/23/2021-23:46:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:20] [V] [TRT] Tactic: 6272216432116166416 time 2.40026 [07/23/2021-23:46:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:20] [V] [TRT] Tactic: 6377497238381488891 time 2.29504 [07/23/2021-23:46:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:20] [V] [TRT] Tactic: 6428823438254963239 time 3.11284 [07/23/2021-23:46:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:20] [V] [TRT] Tactic: 6446388116965632819 time 2.69389 [07/23/2021-23:46:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:20] [V] [TRT] Tactic: 6468794451065529747 time 2.66624 [07/23/2021-23:46:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:20] [V] [TRT] Tactic: 6642277870194067185 time 2.42637 [07/23/2021-23:46:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:20] [V] [TRT] Tactic: 6725284471687256210 time 4.36864 [07/23/2021-23:46:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:46:20] [V] [TRT] Tactic: 6859477213531075460 time 2.92608 [07/23/2021-23:46:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:20] [V] [TRT] Tactic: 7100752989500049598 time 4.45568 [07/23/2021-23:46:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:20] [V] [TRT] Tactic: 7216571380637776659 time 2.49818 [07/23/2021-23:46:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:20] [V] [TRT] Tactic: 7609923741161019135 time 2.72896 [07/23/2021-23:46:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:20] [V] [TRT] Tactic: 7667554089956651578 time 3.13101 [07/23/2021-23:46:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:46:20] [V] [TRT] Tactic: 7705739241028240201 time 3.15789 [07/23/2021-23:46:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:21] [V] [TRT] Tactic: 8040838497444300918 time 4.17192 [07/23/2021-23:46:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:46:21] [V] [TRT] Tactic: 8101703987960976805 time 3.04474 [07/23/2021-23:46:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:21] [V] [TRT] Tactic: 8170606396342855895 time 2.65139 [07/23/2021-23:46:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:21] [V] [TRT] Tactic: 8264928564315835356 time 2.66407 [07/23/2021-23:46:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:21] [V] [TRT] Tactic: 8839784824303350101 time 2.48947 [07/23/2021-23:46:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:46:21] [V] [TRT] Tactic: -9217371357561775773 time 3.40787 [07/23/2021-23:46:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:21] [V] [TRT] Tactic: -9009272790678027912 time 3.46419 [07/23/2021-23:46:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:21] [V] [TRT] Tactic: -8949544755481315679 time 2.57088 [07/23/2021-23:46:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:46:21] [V] [TRT] Tactic: -8604374562669615024 time 3.14291 [07/23/2021-23:46:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:21] [V] [TRT] Tactic: -7938306756270351617 time 4.60544 [07/23/2021-23:46:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:21] [V] [TRT] Tactic: -7027328628217650515 time 2.30285 [07/23/2021-23:46:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:21] [V] [TRT] Tactic: -6840588038605932325 time 2.8457 [07/23/2021-23:46:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:21] [V] [TRT] Tactic: -6603588435230240365 time 4.72064 [07/23/2021-23:46:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:46:21] [V] [TRT] Tactic: -6356316196810535311 time 3.23814 [07/23/2021-23:46:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:21] [V] [TRT] Tactic: -6257787336162086472 time 2.47399 [07/23/2021-23:46:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:21] [V] [TRT] Tactic: -6063766379489217211 time 2.73587 [07/23/2021-23:46:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:21] [V] [TRT] Tactic: -6055152894973171263 time 2.84993 [07/23/2021-23:46:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:22] [V] [TRT] Tactic: -5634849406670564996 time 5.99208 [07/23/2021-23:46:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:22] [V] [TRT] Tactic: -5530886555766748586 time 2.47846 [07/23/2021-23:46:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:22] [V] [TRT] Tactic: -5421613452990385135 time 2.29376 [07/23/2021-23:46:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:22] [V] [TRT] Tactic: -5161596964442251102 time 2.68979 [07/23/2021-23:46:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:22] [V] [TRT] Tactic: -5127240325355316006 time 2.82842 [07/23/2021-23:46:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:22] [V] [TRT] Tactic: -4796511246675321840 time 2.91712 [07/23/2021-23:46:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:46:22] [V] [TRT] Tactic: -4706569565442112734 time 3.29741 [07/23/2021-23:46:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:22] [V] [TRT] Tactic: -4409144516525410768 time 2.47155 [07/23/2021-23:46:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:22] [V] [TRT] Tactic: -4379519430184503304 time 2.66176 [07/23/2021-23:46:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:22] [V] [TRT] Tactic: -4342782565153442362 time 2.42931 [07/23/2021-23:46:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:22] [V] [TRT] Tactic: -4191836638128696671 time 3.29742 [07/23/2021-23:46:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:22] [V] [TRT] Tactic: -4152066959007262150 time 2.36493 [07/23/2021-23:46:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:22] [V] [TRT] Tactic: -4021926646879732549 time 2.77478 [07/23/2021-23:46:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:22] [V] [TRT] Tactic: -3987638434926559037 time 2.89754 [07/23/2021-23:46:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:22] [V] [TRT] Tactic: -3939749857557624176 time 3.32109 [07/23/2021-23:46:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:22] [V] [TRT] Tactic: -3905653247016903130 time 2.60084 [07/23/2021-23:46:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:22] [V] [TRT] Tactic: -3895429239811098010 time 2.85517 [07/23/2021-23:46:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:22] [V] [TRT] Tactic: -3864869056275745423 time 3.27386 [07/23/2021-23:46:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:46:22] [V] [TRT] Tactic: -3601464762214218301 time 2.9321 [07/23/2021-23:46:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:22] [V] [TRT] Tactic: -3412636942650049698 time 2.86144 [07/23/2021-23:46:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:23] [V] [TRT] Tactic: -3058330359340425555 time 2.88474 [07/23/2021-23:46:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:23] [V] [TRT] Tactic: -2893013346565417259 time 3.12704 [07/23/2021-23:46:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:23] [V] [TRT] Tactic: -2816084650627734155 time 3.30266 [07/23/2021-23:46:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:23] [V] [TRT] Tactic: -2559894581585337900 time 2.3831 [07/23/2021-23:46:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:23] [V] [TRT] Tactic: -2241736083352441442 time 2.50598 [07/23/2021-23:46:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:23] [V] [TRT] Tactic: -1985778916402815946 time 3.39215 [07/23/2021-23:46:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:23] [V] [TRT] Tactic: -1979709471637578040 time 3.01826 [07/23/2021-23:46:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:23] [V] [TRT] Tactic: -1824906597022852312 time 4.56422 [07/23/2021-23:46:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:23] [V] [TRT] Tactic: -1727693334586194183 time 3.04538 [07/23/2021-23:46:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:23] [V] [TRT] Tactic: -1657270965825641606 time 2.54286 [07/23/2021-23:46:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:23] [V] [TRT] Tactic: -1500496213132463076 time 2.70144 [07/23/2021-23:46:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:23] [V] [TRT] Tactic: -1194193093145321861 time 4.15424 [07/23/2021-23:46:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:46:23] [V] [TRT] Tactic: -1099247066487349374 time 2.992 [07/23/2021-23:46:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:23] [V] [TRT] Tactic: -705524612929044822 time 2.54054 [07/23/2021-23:46:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:23] [V] [TRT] Tactic: -680956411637736772 time 3.32199 [07/23/2021-23:46:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:23] [V] [TRT] Tactic: -504245585588397229 time 4.06542 [07/23/2021-23:46:23] [V] [TRT] Fastest Tactic: 1156328698016730421 Time: 2.27213 [07/23/2021-23:46:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CudaConvolution) [07/23/2021-23:46:24] [V] [TRT] Tactic: 0 time 27.2626 [07/23/2021-23:46:29] [V] [TRT] Tactic: 1 time 345.346 [07/23/2021-23:46:31] [V] [TRT] Tactic: 2 time 81.8395 [07/23/2021-23:46:31] [V] [TRT] Tactic: 6 time 12.0459 [07/23/2021-23:46:31] [V] [TRT] Tactic: 56 time 27.2675 [07/23/2021-23:46:33] [V] [TRT] Tactic: 58 time 81.972 [07/23/2021-23:46:33] [V] [TRT] Tactic: 62 time 11.9951 [07/23/2021-23:46:33] [V] [TRT] Fastest Tactic: 62 Time: 11.9951 [07/23/2021-23:46:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (CublasConvolution) [07/23/2021-23:46:33] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1156328698016730421 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:33] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:33] [V] [TRT] Tactic: 1002 time 0.98688 [07/23/2021-23:46:33] [V] [TRT] Tactic: 0 time 2.26342 [07/23/2021-23:46:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.98688 [07/23/2021-23:46:33] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:33] [V] [TRT] Tactic: 1002 time 1.0226 [07/23/2021-23:46:33] [V] [TRT] Tactic: 0 time 2.27891 [07/23/2021-23:46:33] [V] [TRT] Fastest Tactic: 1002 Time: 1.0226 [07/23/2021-23:46:33] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:33] [V] [TRT] Tactic: 1002 time 0.77696 [07/23/2021-23:46:33] [V] [TRT] Tactic: 0 time 0.90804 [07/23/2021-23:46:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.77696 [07/23/2021-23:46:33] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:33] [V] [TRT] Tactic: 1002 time 1.10426 [07/23/2021-23:46:33] [V] [TRT] Tactic: 0 time 0.659092 [07/23/2021-23:46:33] [V] [TRT] Fastest Tactic: 0 Time: 0.659092 [07/23/2021-23:46:33] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:33] [V] [TRT] Tactic: 1002 time 0.83584 [07/23/2021-23:46:33] [V] [TRT] Tactic: 0 time 0.688 [07/23/2021-23:46:33] [V] [TRT] Fastest Tactic: 0 Time: 0.688 [07/23/2021-23:46:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:34] [V] [TRT] Tactic: 1002 time 0.980096 [07/23/2021-23:46:34] [V] [TRT] Tactic: 0 time 4.34278 [07/23/2021-23:46:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.980096 [07/23/2021-23:46:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:34] [V] [TRT] Tactic: 1002 time 1.57518 [07/23/2021-23:46:34] [V] [TRT] Tactic: 0 time 0.902912 [07/23/2021-23:46:34] [V] [TRT] Fastest Tactic: 0 Time: 0.902912 [07/23/2021-23:46:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:34] [V] [TRT] Tactic: 1002 time 0.75648 [07/23/2021-23:46:34] [V] [TRT] Tactic: 0 time 3.90605 [07/23/2021-23:46:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.75648 [07/23/2021-23:46:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:34] [V] [TRT] Tactic: 1002 time 1.23763 [07/23/2021-23:46:34] [V] [TRT] Tactic: 0 time 4.3863 [07/23/2021-23:46:34] [V] [TRT] Fastest Tactic: 1002 Time: 1.23763 [07/23/2021-23:46:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:34] [V] [TRT] Tactic: 1002 time 1.55469 [07/23/2021-23:46:34] [V] [TRT] Tactic: 0 time 0.645632 [07/23/2021-23:46:34] [V] [TRT] Fastest Tactic: 0 Time: 0.645632 [07/23/2021-23:46:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:34] [V] [TRT] Tactic: 1002 time 1.02208 [07/23/2021-23:46:34] [V] [TRT] Tactic: 0 time 4.34432 [07/23/2021-23:46:34] [V] [TRT] Fastest Tactic: 1002 Time: 1.02208 [07/23/2021-23:46:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:35] [V] [TRT] Tactic: 1002 time 1.58093 [07/23/2021-23:46:35] [V] [TRT] Tactic: 0 time 0.904192 [07/23/2021-23:46:35] [V] [TRT] Fastest Tactic: 0 Time: 0.904192 [07/23/2021-23:46:35] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:35] [V] [TRT] Tactic: 1002 time 0.835712 [07/23/2021-23:46:35] [V] [TRT] Tactic: 0 time 3.90502 [07/23/2021-23:46:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.835712 [07/23/2021-23:46:35] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:35] [V] [TRT] Tactic: 1002 time 1.23904 [07/23/2021-23:46:35] [V] [TRT] Tactic: 0 time 4.38835 [07/23/2021-23:46:35] [V] [TRT] Fastest Tactic: 1002 Time: 1.23904 [07/23/2021-23:46:35] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:35] [V] [TRT] Tactic: 1002 time 1.55251 [07/23/2021-23:46:35] [V] [TRT] Tactic: 0 time 0.660608 [07/23/2021-23:46:35] [V] [TRT] Fastest Tactic: 0 Time: 0.660608 [07/23/2021-23:46:35] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:35] [V] [TRT] Tactic: 1002 time 0.817152 [07/23/2021-23:46:35] [V] [TRT] Tactic: 0 time 1.07392 [07/23/2021-23:46:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.817152 [07/23/2021-23:46:35] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:35] [V] [TRT] Tactic: 1002 time 0.78144 [07/23/2021-23:46:35] [V] [TRT] Tactic: 0 time 0.989696 [07/23/2021-23:46:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.78144 [07/23/2021-23:46:35] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:35] [V] [TRT] Tactic: 1002 time 0.893696 [07/23/2021-23:46:35] [V] [TRT] Tactic: 0 time 0.999424 [07/23/2021-23:46:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.893696 [07/23/2021-23:46:35] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:35] [V] [TRT] Tactic: 1002 time 1.11091 [07/23/2021-23:46:36] [V] [TRT] Tactic: 0 time 0.46336 [07/23/2021-23:46:36] [V] [TRT] Fastest Tactic: 0 Time: 0.46336 [07/23/2021-23:46:36] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:36] [V] [TRT] Tactic: 1002 time 0.801536 [07/23/2021-23:46:36] [V] [TRT] Tactic: 0 time 0.477184 [07/23/2021-23:46:36] [V] [TRT] Fastest Tactic: 0 Time: 0.477184 [07/23/2021-23:46:36] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:36] [V] [TRT] Tactic: 1002 time 1.23635 [07/23/2021-23:46:36] [V] [TRT] Tactic: 0 time 0.678016 [07/23/2021-23:46:36] [V] [TRT] Fastest Tactic: 0 Time: 0.678016 [07/23/2021-23:46:36] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:36] [V] [TRT] Tactic: 1002 time 0.831488 [07/23/2021-23:46:36] [V] [TRT] Tactic: 0 time 0.770304 [07/23/2021-23:46:36] [V] [TRT] Fastest Tactic: 0 Time: 0.770304 [07/23/2021-23:46:36] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:36] [V] [TRT] Tactic: 1002 time 0.831616 [07/23/2021-23:46:36] [V] [TRT] Tactic: 0 time 0.783744 [07/23/2021-23:46:36] [V] [TRT] Fastest Tactic: 0 Time: 0.783744 [07/23/2021-23:46:36] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:36] [V] [TRT] Tactic: 1002 time 1.21062 [07/23/2021-23:46:36] [V] [TRT] Tactic: 0 time 0.446848 [07/23/2021-23:46:36] [V] [TRT] Fastest Tactic: 0 Time: 0.446848 [07/23/2021-23:46:36] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:36] [V] [TRT] Tactic: 1002 time 0.779776 [07/23/2021-23:46:36] [V] [TRT] Tactic: 0 time 0.481024 [07/23/2021-23:46:36] [V] [TRT] Fastest Tactic: 0 Time: 0.481024 [07/23/2021-23:46:36] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:36] [V] [TRT] Tactic: 1002 time 0.891648 [07/23/2021-23:46:36] [V] [TRT] Tactic: 0 time 0.699392 [07/23/2021-23:46:36] [V] [TRT] Fastest Tactic: 0 Time: 0.699392 [07/23/2021-23:46:36] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:36] [V] [TRT] Tactic: 1002 time 1.6233 [07/23/2021-23:46:36] [V] [TRT] Tactic: 0 time 0.673408 [07/23/2021-23:46:36] [V] [TRT] Fastest Tactic: 0 Time: 0.673408 [07/23/2021-23:46:36] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:37] [V] [TRT] Tactic: 1002 time 1.62368 [07/23/2021-23:46:37] [V] [TRT] Tactic: 0 time 0.686336 [07/23/2021-23:46:37] [V] [TRT] Fastest Tactic: 0 Time: 0.686336 [07/23/2021-23:46:37] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:37] [V] [TRT] Tactic: 1002 time 0.795776 [07/23/2021-23:46:37] [V] [TRT] Tactic: 0 time 0.468096 [07/23/2021-23:46:37] [V] [TRT] Fastest Tactic: 0 Time: 0.468096 [07/23/2021-23:46:37] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:37] [V] [TRT] Tactic: 1002 time 1.13216 [07/23/2021-23:46:37] [V] [TRT] Tactic: 0 time 0.465408 [07/23/2021-23:46:37] [V] [TRT] Fastest Tactic: 0 Time: 0.465408 [07/23/2021-23:46:37] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,8388608) -> Float(1,256,65536,4194304) *************** [07/23/2021-23:46:37] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 [07/23/2021-23:46:37] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 [07/23/2021-23:46:37] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 [07/23/2021-23:46:37] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 [07/23/2021-23:46:37] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 [07/23/2021-23:46:37] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 [07/23/2021-23:46:37] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 [07/23/2021-23:46:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (FusedConvActConvolution) [07/23/2021-23:46:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CaskConvolution) [07/23/2021-23:46:37] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 [07/23/2021-23:46:37] [V] [TRT] Tactic: 4549827808004681195 time 3.61767 [07/23/2021-23:46:37] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 [07/23/2021-23:46:37] [V] [TRT] Tactic: 5779835512569528575 time 7.20691 [07/23/2021-23:46:37] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 [07/23/2021-23:46:37] [V] [TRT] Tactic: 6053873026024413720 time 7.52576 [07/23/2021-23:46:37] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 [07/23/2021-23:46:37] [V] [TRT] Tactic: 6767548733843469815 time 3.88019 [07/23/2021-23:46:37] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 [07/23/2021-23:46:37] [V] [TRT] Tactic: -6313876406580483184 time 4.42933 [07/23/2021-23:46:37] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 [07/23/2021-23:46:37] [V] [TRT] Tactic: -1123676555321336786 time 7.21562 [07/23/2021-23:46:37] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 [07/23/2021-23:46:37] [V] [TRT] Tactic: -701551393537224327 time 4.15821 [07/23/2021-23:46:37] [V] [TRT] Fastest Tactic: 4549827808004681195 Time: 3.61767 [07/23/2021-23:46:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CudaConvolution) [07/23/2021-23:46:38] [V] [TRT] Tactic: 0 time 10.158 [07/23/2021-23:46:38] [V] [TRT] Tactic: 1 time 3.65517 [07/23/2021-23:46:38] [V] [TRT] Tactic: 2 time 14.1581 [07/23/2021-23:46:38] [V] [TRT] Tactic: 5 time 9.22655 [07/23/2021-23:46:38] [V] [TRT] Tactic: 6 time 3.37702 [07/23/2021-23:46:38] [V] [TRT] Tactic: 56 time 9.97747 [07/23/2021-23:46:38] [V] [TRT] Tactic: 57 time 3.64186 [07/23/2021-23:46:39] [V] [TRT] Tactic: 58 time 14.1719 [07/23/2021-23:46:39] [V] [TRT] Tactic: 61 time 9.28476 [07/23/2021-23:46:39] [V] [TRT] Tactic: 62 time 3.37037 [07/23/2021-23:46:39] [V] [TRT] Tactic: 112 time 10.1608 [07/23/2021-23:46:39] [V] [TRT] Tactic: 113 time 4.75213 [07/23/2021-23:46:39] [V] [TRT] Tactic: 114 time 14.2163 [07/23/2021-23:46:40] [V] [TRT] Tactic: 117 time 9.21267 [07/23/2021-23:46:40] [V] [TRT] Tactic: 118 time 3.37346 [07/23/2021-23:46:40] [V] [TRT] Fastest Tactic: 62 Time: 3.37037 [07/23/2021-23:46:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CublasConvolution) [07/23/2021-23:46:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 62 [07/23/2021-23:46:40] [V] [TRT] [07/23/2021-23:46:40] [V] [TRT] *************** Autotuning format combination: Float(128,32768,1,8388608) -> Float(64,16384,1,4194304) *************** [07/23/2021-23:46:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (FusedConvActConvolution) [07/23/2021-23:46:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CaskConvolution) [07/23/2021-23:46:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:40] [V] [TRT] Tactic: 2860655430572478466 time 3.60512 [07/23/2021-23:46:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:40] [V] [TRT] Tactic: 4474630279712975759 time 4.29926 [07/23/2021-23:46:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:40] [V] [TRT] Tactic: 4479823862704990365 time 4.36864 [07/23/2021-23:46:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:40] [V] [TRT] Tactic: 4696204239951173149 time 3.98784 [07/23/2021-23:46:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:40] [V] [TRT] Tactic: 5778138195697110003 time 7.24275 [07/23/2021-23:46:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:40] [V] [TRT] Tactic: 7155825427510256858 time 7.16019 [07/23/2021-23:46:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:40] [V] [TRT] Tactic: 8918020581761223752 time 7.18221 [07/23/2021-23:46:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:40] [V] [TRT] Tactic: -4756382386362004279 time 3.96045 [07/23/2021-23:46:40] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] Tactic: -3855385237722507464 time 7.23558 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] Tactic: -2809379259463049391 time 7.46061 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] Tactic: -504296718212024303 time 7.17414 [07/23/2021-23:46:41] [V] [TRT] Fastest Tactic: 2860655430572478466 Time: 3.60512 [07/23/2021-23:46:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CudaConvolution) [07/23/2021-23:46:41] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CublasConvolution) [07/23/2021-23:46:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2860655430572478466 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] *************** Autotuning format combination: Float(32,8192,1:4,2097152) -> Float(16,4096,1:4,1048576) *************** [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_indexed_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (FusedConvActConvolution) [07/23/2021-23:46:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CaskConvolution) [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] Tactic: 2860655430572478466 time 3.5904 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] Tactic: 4474630279712975759 time 4.33062 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] Tactic: 4479823862704990365 time 4.31526 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] Tactic: 4696204239951173149 time 3.96416 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:41] [V] [TRT] Tactic: 5778138195697110003 time 7.15047 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_indexed_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:41] [V] [TRT] Tactic: 6642501658177097719 time 2.83597 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:41] [V] [TRT] Tactic: 6670616668161295401 time 2.70899 [07/23/2021-23:46:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:42] [V] [TRT] Tactic: 7155825427510256858 time 6.6688 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:42] [V] [TRT] Tactic: 8918020581761223752 time 7.18541 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:42] [V] [TRT] Tactic: -8844488725130067278 time 2.67405 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:42] [V] [TRT] Tactic: -4756382386362004279 time 3.7696 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:42] [V] [TRT] Tactic: -3855385237722507464 time 7.22638 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:42] [V] [TRT] Tactic: -2809379259463049391 time 7.49798 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:42] [V] [TRT] Tactic: -504296718212024303 time 7.2055 [07/23/2021-23:46:42] [V] [TRT] Fastest Tactic: -8844488725130067278 Time: 2.67405 [07/23/2021-23:46:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CudaConvolution) [07/23/2021-23:46:42] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CublasConvolution) [07/23/2021-23:46:42] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8844488725130067278 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:42] [V] [TRT] [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_indexed_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:42] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:42] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,8388608) -> Half(1,256,65536,4194304) *************** [07/23/2021-23:46:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (FusedConvActConvolution) [07/23/2021-23:46:42] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CaskConvolution) [07/23/2021-23:46:42] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CudaConvolution) [07/23/2021-23:46:42] [V] [TRT] Tactic: 0 time 9.4871 [07/23/2021-23:46:42] [V] [TRT] Tactic: 1 time 4.91469 [07/23/2021-23:46:43] [V] [TRT] Tactic: 2 time 11.8488 [07/23/2021-23:46:43] [V] [TRT] Tactic: 5 time 8.34318 [07/23/2021-23:46:43] [V] [TRT] Tactic: 6 time 4.01344 [07/23/2021-23:46:43] [V] [TRT] Tactic: 56 time 9.8304 [07/23/2021-23:46:43] [V] [TRT] Tactic: 58 time 12.1472 [07/23/2021-23:46:43] [V] [TRT] Tactic: 61 time 8.25461 [07/23/2021-23:46:44] [V] [TRT] Tactic: 62 time 4.0229 [07/23/2021-23:46:44] [V] [TRT] Fastest Tactic: 6 Time: 4.01344 [07/23/2021-23:46:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CublasConvolution) [07/23/2021-23:46:44] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [07/23/2021-23:46:44] [V] [TRT] [07/23/2021-23:46:44] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,4194304) -> Half(1,256,65536:2,2097152) *************** [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:46:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (FusedConvActConvolution) [07/23/2021-23:46:44] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CaskConvolution) [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:46:44] [V] [TRT] Tactic: 2195670545862694453 time 2.20431 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:46:44] [V] [TRT] Tactic: 3419182076704469245 time 2.34626 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:46:44] [V] [TRT] Tactic: 3891805945559659536 time 4.50125 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:46:44] [V] [TRT] Tactic: 5548126322150286555 time 2.2313 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:46:44] [V] [TRT] Tactic: 6057304366605292508 time 2.25997 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:46:44] [V] [TRT] Tactic: -7928611605886347652 time 4.53376 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:46:44] [V] [TRT] Tactic: -5172391392092686714 time 2.29312 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:46:44] [V] [TRT] Tactic: -4374269919094467161 time 2.31412 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:46:44] [V] [TRT] Tactic: -4083394051665370953 time 1.31328 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:46:44] [V] [TRT] Tactic: -1546027692247304867 time 4.47923 [07/23/2021-23:46:44] [V] [TRT] Fastest Tactic: -4083394051665370953 Time: 1.31328 [07/23/2021-23:46:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CudaConvolution) [07/23/2021-23:46:44] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CublasConvolution) [07/23/2021-23:46:44] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4083394051665370953 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:46:44] [V] [TRT] [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:46:44] [V] [TRT] *************** Autotuning format combination: Half(16,4096,1:8,1048576) -> Float(1,256,65536,4194304) *************** [07/23/2021-23:46:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (FusedConvActConvolution) [07/23/2021-23:46:44] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CaskConvolution) [07/23/2021-23:46:44] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CudaConvolution) [07/23/2021-23:46:44] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CublasConvolution) [07/23/2021-23:46:44] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:44] [V] [TRT] *************** Autotuning format combination: Half(16,4096,1:8,1048576) -> Half(8,2048,1:8,524288) *************** [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (FusedConvActConvolution) [07/23/2021-23:46:44] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CaskConvolution) [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] Tactic: 254850674756030979 time 1.18991 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] Tactic: 1156328698016730421 time 1.12858 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:44] [V] [TRT] Tactic: 1584305878200231339 time 1.23238 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] Tactic: 1832046141070096030 time 0.751376 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] Tactic: 1838082074606840426 time 0.747776 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] Tactic: 1899296423087490472 time 0.896256 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:44] [V] [TRT] Tactic: 2338136297163812551 time 1.24378 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] Tactic: 2541579301352125276 time 1.24494 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] Tactic: 2657157263811141609 time 0.91072 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:44] [V] [TRT] Tactic: 2819719497590964443 time 1.43846 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:44] [V] [TRT] Tactic: 2835786846016979545 time 1.65043 [07/23/2021-23:46:44] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 2968605903460894194 time 0.74432 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 2986078304285316765 time 1.25619 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 3362537467505018070 time 1.24365 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 3513075359009385578 time 1.23368 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:45] [V] [TRT] Tactic: 3546424067684403057 time 1.6919 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 3573559043797674382 time 0.743808 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 3704534001553878387 time 1.12794 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 4278315135102886928 time 1.38368 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:45] [V] [TRT] Tactic: 4750655167565104065 time 0.906112 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 4802447371470387646 time 0.90432 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 5059676457552313631 time 1.19373 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 5398999388616959893 time 0.856192 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:45] [V] [TRT] Tactic: 5579149726397848560 time 0.7744 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 5746691132547383910 time 1.39533 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 5770170567977052602 time 0.873088 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:45] [V] [TRT] Tactic: 5896806418498994339 time 1.12166 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 6034364043891107501 time 1.32467 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 6074229447555668232 time 0.921344 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:45] [V] [TRT] Tactic: 6176524653920166422 time 0.843396 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:45] [V] [TRT] Tactic: 6272216432116166416 time 1.28499 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 6377497238381488891 time 1.24622 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:45] [V] [TRT] Tactic: 6428823438254963239 time 0.854916 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 6446388116965632819 time 0.739712 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 6468794451065529747 time 0.755584 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 6642277870194067185 time 1.24993 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:45] [V] [TRT] Tactic: 6725284471687256210 time 1.13395 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 6859477213531075460 time 0.880256 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:45] [V] [TRT] Tactic: 7100752989500049598 time 1.12922 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 7216571380637776659 time 0.805504 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 7609923741161019135 time 0.728576 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:45] [V] [TRT] Tactic: 7667554089956651578 time 0.79578 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 7705739241028240201 time 0.934016 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:45] [V] [TRT] Tactic: 8040838497444300918 time 1.22125 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 8101703987960976805 time 0.940672 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 8170606396342855895 time 0.749952 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:45] [V] [TRT] Tactic: 8264928564315835356 time 0.790784 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: 8839784824303350101 time 0.778376 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: -9217371357561775773 time 0.939008 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: -9009272790678027912 time 0.892804 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: -8949544755481315679 time 0.747136 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: -8604374562669615024 time 0.899968 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:45] [V] [TRT] Tactic: -7938306756270351617 time 2.29338 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:45] [V] [TRT] Tactic: -7027328628217650515 time 1.25133 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: -6840588038605932325 time 1.40492 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:45] [V] [TRT] Tactic: -6603588435230240365 time 2.41652 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: -6356316196810535311 time 1.00301 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:45] [V] [TRT] Tactic: -6257787336162086472 time 1.18452 [07/23/2021-23:46:45] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -6063766379489217211 time 0.750464 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:46] [V] [TRT] Tactic: -6055152894973171263 time 1.45102 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:46] [V] [TRT] Tactic: -5634849406670564996 time 1.69588 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -5530886555766748586 time 1.22381 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:46] [V] [TRT] Tactic: -5421613452990385135 time 1.18388 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -5161596964442251102 time 1.3988 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -5127240325355316006 time 1.34836 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -4796511246675321840 time 1.4729 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -4706569565442112734 time 1.01261 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -4409144516525410768 time 1.27488 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -4379519430184503304 time 0.732928 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:46] [V] [TRT] Tactic: -4342782565153442362 time 1.1936 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:46] [V] [TRT] Tactic: -4191836638128696671 time 0.926216 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -4152066959007262150 time 1.20961 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -4021926646879732549 time 1.36115 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -3987638434926559037 time 1.46253 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:46] [V] [TRT] Tactic: -3939749857557624176 time 0.96832 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -3905653247016903130 time 0.867584 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -3895429239811098010 time 1.34656 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -3864869056275745423 time 0.861732 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -3601464762214218301 time 0.877696 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -3412636942650049698 time 0.868736 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -3058330359340425555 time 1.4039 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:46] [V] [TRT] Tactic: -2893013346565417259 time 1.3019 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -2816084650627734155 time 0.91418 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -2559894581585337900 time 1.23329 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -2241736083352441442 time 0.808448 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -1985778916402815946 time 0.888724 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:46] [V] [TRT] Tactic: -1979709471637578040 time 1.5474 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:46] [V] [TRT] Tactic: -1824906597022852312 time 2.36904 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:46] [V] [TRT] Tactic: -1727693334586194183 time 1.32826 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:46] [V] [TRT] Tactic: -1657270965825641606 time 1.37357 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -1500496213132463076 time 0.796544 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:46] [V] [TRT] Tactic: -1194193093145321861 time 1.20538 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:46:46] [V] [TRT] Tactic: -1099247066487349374 time 0.892164 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:46] [V] [TRT] Tactic: -705524612929044822 time 1.20627 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:46] [V] [TRT] Tactic: -680956411637736772 time 0.963328 [07/23/2021-23:46:46] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:46] [V] [TRT] Tactic: -504245585588397229 time 1.13524 [07/23/2021-23:46:46] [V] [TRT] Fastest Tactic: 7609923741161019135 Time: 0.728576 [07/23/2021-23:46:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CudaConvolution) [07/23/2021-23:46:47] [V] [TRT] Tactic: 0 time 12.6655 [07/23/2021-23:46:48] [V] [TRT] Tactic: 1 time 79.9117 [07/23/2021-23:46:48] [V] [TRT] Tactic: 2 time 35.6868 [07/23/2021-23:46:49] [V] [TRT] Tactic: 6 time 4.04772 [07/23/2021-23:46:49] [V] [TRT] Tactic: 56 time 12.812 [07/23/2021-23:46:49] [V] [TRT] Tactic: 58 time 36.22 [07/23/2021-23:46:49] [V] [TRT] Tactic: 62 time 4.05054 [07/23/2021-23:46:49] [V] [TRT] Fastest Tactic: 6 Time: 4.04772 [07/23/2021-23:46:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (CublasConvolution) [07/23/2021-23:46:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7609923741161019135 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:49] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:49] [V] [TRT] Tactic: 1002 time 0.493312 [07/23/2021-23:46:50] [V] [TRT] Tactic: 0 time 0.474496 [07/23/2021-23:46:50] [V] [TRT] Fastest Tactic: 0 Time: 0.474496 [07/23/2021-23:46:50] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:50] [V] [TRT] Tactic: 1002 time 0.510592 [07/23/2021-23:46:50] [V] [TRT] Tactic: 0 time 0.476288 [07/23/2021-23:46:50] [V] [TRT] Fastest Tactic: 0 Time: 0.476288 [07/23/2021-23:46:50] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:50] [V] [TRT] Tactic: 1002 time 0.388736 [07/23/2021-23:46:50] [V] [TRT] Tactic: 0 time 0.460288 [07/23/2021-23:46:50] [V] [TRT] Fastest Tactic: 1002 Time: 0.388736 [07/23/2021-23:46:50] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:50] [V] [TRT] Tactic: 1002 time 0.565248 [07/23/2021-23:46:50] [V] [TRT] Tactic: 0 time 0.33024 [07/23/2021-23:46:50] [V] [TRT] Fastest Tactic: 0 Time: 0.33024 [07/23/2021-23:46:50] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:50] [V] [TRT] Tactic: 1002 time 0.416256 [07/23/2021-23:46:50] [V] [TRT] Tactic: 0 time 0.34112 [07/23/2021-23:46:50] [V] [TRT] Fastest Tactic: 0 Time: 0.34112 [07/23/2021-23:46:50] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:50] [V] [TRT] Tactic: 1002 time 0.490368 [07/23/2021-23:46:50] [V] [TRT] Tactic: 0 time 2.12659 [07/23/2021-23:46:50] [V] [TRT] Fastest Tactic: 1002 Time: 0.490368 [07/23/2021-23:46:50] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:50] [V] [TRT] Tactic: 1002 time 1.22957 [07/23/2021-23:46:50] [V] [TRT] Tactic: 0 time 0.450816 [07/23/2021-23:46:50] [V] [TRT] Fastest Tactic: 0 Time: 0.450816 [07/23/2021-23:46:50] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:50] [V] [TRT] Tactic: 1002 time 0.377856 [07/23/2021-23:46:50] [V] [TRT] Tactic: 0 time 1.98157 [07/23/2021-23:46:50] [V] [TRT] Fastest Tactic: 1002 Time: 0.377856 [07/23/2021-23:46:50] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:50] [V] [TRT] Tactic: 1002 time 0.626944 [07/23/2021-23:46:50] [V] [TRT] Tactic: 0 time 2.23104 [07/23/2021-23:46:50] [V] [TRT] Fastest Tactic: 1002 Time: 0.626944 [07/23/2021-23:46:50] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:50] [V] [TRT] Tactic: 1002 time 1.22714 [07/23/2021-23:46:51] [V] [TRT] Tactic: 0 time 0.325124 [07/23/2021-23:46:51] [V] [TRT] Fastest Tactic: 0 Time: 0.325124 [07/23/2021-23:46:51] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:51] [V] [TRT] Tactic: 1002 time 0.511488 [07/23/2021-23:46:51] [V] [TRT] Tactic: 0 time 2.13018 [07/23/2021-23:46:51] [V] [TRT] Fastest Tactic: 1002 Time: 0.511488 [07/23/2021-23:46:51] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:51] [V] [TRT] Tactic: 1002 time 1.23046 [07/23/2021-23:46:51] [V] [TRT] Tactic: 0 time 0.451072 [07/23/2021-23:46:51] [V] [TRT] Fastest Tactic: 0 Time: 0.451072 [07/23/2021-23:46:51] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:51] [V] [TRT] Tactic: 1002 time 0.41664 [07/23/2021-23:46:51] [V] [TRT] Tactic: 0 time 1.98566 [07/23/2021-23:46:51] [V] [TRT] Fastest Tactic: 1002 Time: 0.41664 [07/23/2021-23:46:51] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:51] [V] [TRT] Tactic: 1002 time 0.626048 [07/23/2021-23:46:51] [V] [TRT] Tactic: 0 time 2.20672 [07/23/2021-23:46:51] [V] [TRT] Fastest Tactic: 1002 Time: 0.626048 [07/23/2021-23:46:51] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:51] [V] [TRT] Tactic: 1002 time 1.22675 [07/23/2021-23:46:51] [V] [TRT] Tactic: 0 time 0.33344 [07/23/2021-23:46:51] [V] [TRT] Fastest Tactic: 0 Time: 0.33344 [07/23/2021-23:46:51] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:51] [V] [TRT] Tactic: 1002 time 0.4096 [07/23/2021-23:46:51] [V] [TRT] Tactic: 0 time 0.535936 [07/23/2021-23:46:51] [V] [TRT] Fastest Tactic: 1002 Time: 0.4096 [07/23/2021-23:46:51] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:51] [V] [TRT] Tactic: 1002 time 0.386944 [07/23/2021-23:46:51] [V] [TRT] Tactic: 0 time 0.398336 [07/23/2021-23:46:51] [V] [TRT] Fastest Tactic: 1002 Time: 0.386944 [07/23/2021-23:46:51] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:51] [V] [TRT] Tactic: 1002 time 0.446592 [07/23/2021-23:46:51] [V] [TRT] Tactic: 0 time 0.40192 [07/23/2021-23:46:51] [V] [TRT] Fastest Tactic: 0 Time: 0.40192 [07/23/2021-23:46:51] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:51] [V] [TRT] Tactic: 1002 time 0.559616 [07/23/2021-23:46:52] [V] [TRT] Tactic: 0 time 0.233984 [07/23/2021-23:46:52] [V] [TRT] Fastest Tactic: 0 Time: 0.233984 [07/23/2021-23:46:52] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:52] [V] [TRT] Tactic: 1002 time 0.404096 [07/23/2021-23:46:52] [V] [TRT] Tactic: 0 time 0.2368 [07/23/2021-23:46:52] [V] [TRT] Fastest Tactic: 0 Time: 0.2368 [07/23/2021-23:46:52] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:52] [V] [TRT] Tactic: 1002 time 0.62144 [07/23/2021-23:46:52] [V] [TRT] Tactic: 0 time 0.34112 [07/23/2021-23:46:52] [V] [TRT] Fastest Tactic: 0 Time: 0.34112 [07/23/2021-23:46:52] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:52] [V] [TRT] Tactic: 1002 time 0.424064 [07/23/2021-23:46:52] [V] [TRT] Tactic: 0 time 0.37312 [07/23/2021-23:46:52] [V] [TRT] Fastest Tactic: 0 Time: 0.37312 [07/23/2021-23:46:52] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:52] [V] [TRT] Tactic: 1002 time 0.423296 [07/23/2021-23:46:52] [V] [TRT] Tactic: 0 time 0.379264 [07/23/2021-23:46:52] [V] [TRT] Fastest Tactic: 0 Time: 0.379264 [07/23/2021-23:46:52] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:52] [V] [TRT] Tactic: 1002 time 0.610944 [07/23/2021-23:46:52] [V] [TRT] Tactic: 0 time 0.22528 [07/23/2021-23:46:52] [V] [TRT] Fastest Tactic: 0 Time: 0.22528 [07/23/2021-23:46:52] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:52] [V] [TRT] Tactic: 1002 time 0.394752 [07/23/2021-23:46:52] [V] [TRT] Tactic: 0 time 0.24 [07/23/2021-23:46:52] [V] [TRT] Fastest Tactic: 0 Time: 0.24 [07/23/2021-23:46:52] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:52] [V] [TRT] Tactic: 1002 time 0.443648 [07/23/2021-23:46:52] [V] [TRT] Tactic: 0 time 0.345472 [07/23/2021-23:46:52] [V] [TRT] Fastest Tactic: 0 Time: 0.345472 [07/23/2021-23:46:52] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:52] [V] [TRT] Tactic: 1002 time 1.25274 [07/23/2021-23:46:52] [V] [TRT] Tactic: 0 time 0.33984 [07/23/2021-23:46:52] [V] [TRT] Fastest Tactic: 0 Time: 0.33984 [07/23/2021-23:46:52] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:52] [V] [TRT] Tactic: 1002 time 1.25286 [07/23/2021-23:46:52] [V] [TRT] Tactic: 0 time 0.345216 [07/23/2021-23:46:52] [V] [TRT] Fastest Tactic: 0 Time: 0.345216 [07/23/2021-23:46:52] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:52] [V] [TRT] Tactic: 1002 time 0.40128 [07/23/2021-23:46:52] [V] [TRT] Tactic: 0 time 0.228224 [07/23/2021-23:46:52] [V] [TRT] Fastest Tactic: 0 Time: 0.228224 [07/23/2021-23:46:52] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:53] [V] [TRT] Tactic: 1002 time 0.571008 [07/23/2021-23:46:53] [V] [TRT] Tactic: 0 time 0.227456 [07/23/2021-23:46:53] [V] [TRT] Fastest Tactic: 0 Time: 0.227456 [07/23/2021-23:46:53] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,4194304) -> Float(1,256,65536,2097152) *************** [07/23/2021-23:46:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 [07/23/2021-23:46:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 [07/23/2021-23:46:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 [07/23/2021-23:46:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 [07/23/2021-23:46:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 [07/23/2021-23:46:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 [07/23/2021-23:46:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 [07/23/2021-23:46:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (FusedConvActConvolution) [07/23/2021-23:46:53] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CaskConvolution) [07/23/2021-23:46:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 [07/23/2021-23:46:53] [V] [TRT] Tactic: 4549827808004681195 time 1.83245 [07/23/2021-23:46:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 [07/23/2021-23:46:53] [V] [TRT] Tactic: 5779835512569528575 time 3.56006 [07/23/2021-23:46:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 [07/23/2021-23:46:53] [V] [TRT] Tactic: 6053873026024413720 time 3.91194 [07/23/2021-23:46:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 [07/23/2021-23:46:53] [V] [TRT] Tactic: 6767548733843469815 time 1.96942 [07/23/2021-23:46:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 [07/23/2021-23:46:53] [V] [TRT] Tactic: -6313876406580483184 time 1.16954 [07/23/2021-23:46:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 [07/23/2021-23:46:53] [V] [TRT] Tactic: -1123676555321336786 time 3.63546 [07/23/2021-23:46:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 [07/23/2021-23:46:53] [V] [TRT] Tactic: -701551393537224327 time 2.07629 [07/23/2021-23:46:53] [V] [TRT] Fastest Tactic: -6313876406580483184 Time: 1.16954 [07/23/2021-23:46:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CudaConvolution) [07/23/2021-23:46:53] [V] [TRT] Tactic: 0 time 4.79629 [07/23/2021-23:46:53] [V] [TRT] Tactic: 1 time 1.71008 [07/23/2021-23:46:53] [V] [TRT] Tactic: 2 time 7.08019 [07/23/2021-23:46:53] [V] [TRT] Tactic: 5 time 3.75482 [07/23/2021-23:46:53] [V] [TRT] Tactic: 6 time 1.5049 [07/23/2021-23:46:53] [V] [TRT] Tactic: 56 time 4.62541 [07/23/2021-23:46:53] [V] [TRT] Tactic: 57 time 1.69766 [07/23/2021-23:46:54] [V] [TRT] Tactic: 58 time 7.09173 [07/23/2021-23:46:54] [V] [TRT] Tactic: 61 time 3.7301 [07/23/2021-23:46:54] [V] [TRT] Tactic: 62 time 1.50541 [07/23/2021-23:46:54] [V] [TRT] Tactic: 112 time 4.62772 [07/23/2021-23:46:54] [V] [TRT] Tactic: 113 time 1.69434 [07/23/2021-23:46:54] [V] [TRT] Tactic: 114 time 7.08134 [07/23/2021-23:46:54] [V] [TRT] Tactic: 117 time 3.75779 [07/23/2021-23:46:54] [V] [TRT] Tactic: 118 time 1.50452 [07/23/2021-23:46:54] [V] [TRT] Fastest Tactic: 118 Time: 1.50452 [07/23/2021-23:46:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:54] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CublasConvolution) [07/23/2021-23:46:54] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6313876406580483184 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 [07/23/2021-23:46:54] [V] [TRT] [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 [07/23/2021-23:46:54] [V] [TRT] *************** Autotuning format combination: Float(64,16384,1,4194304) -> Float(32,8192,1,2097152) *************** [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (FusedConvActConvolution) [07/23/2021-23:46:54] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CaskConvolution) [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:54] [V] [TRT] Tactic: 2860655430572478466 time 1.82093 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:54] [V] [TRT] Tactic: 4474630279712975759 time 1.07597 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:54] [V] [TRT] Tactic: 4479823862704990365 time 1.10541 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:54] [V] [TRT] Tactic: 4696204239951173149 time 1.97683 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:54] [V] [TRT] Tactic: 5778138195697110003 time 3.55021 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:54] [V] [TRT] Tactic: 7155825427510256858 time 3.62278 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:54] [V] [TRT] Tactic: 8918020581761223752 time 3.63008 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:54] [V] [TRT] Tactic: -4756382386362004279 time 2.07565 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:54] [V] [TRT] Tactic: -3855385237722507464 time 3.67119 [07/23/2021-23:46:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] Tactic: -2809379259463049391 time 3.75028 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] Tactic: -504296718212024303 time 3.59552 [07/23/2021-23:46:55] [V] [TRT] Fastest Tactic: 4474630279712975759 Time: 1.07597 [07/23/2021-23:46:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CudaConvolution) [07/23/2021-23:46:55] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CublasConvolution) [07/23/2021-23:46:55] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4474630279712975759 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] *************** Autotuning format combination: Float(16,4096,1:4,1048576) -> Float(8,2048,1:4,524288) *************** [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_indexed_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (FusedConvActConvolution) [07/23/2021-23:46:55] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CaskConvolution) [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] Tactic: 2860655430572478466 time 1.82208 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] Tactic: 4474630279712975759 time 1.0679 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] Tactic: 4479823862704990365 time 1.09965 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] Tactic: 4696204239951173149 time 1.9945 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] Tactic: 5778138195697110003 time 3.5305 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_indexed_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:55] [V] [TRT] Tactic: 6642501658177097719 time 1.60128 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:55] [V] [TRT] Tactic: 6670616668161295401 time 1.49761 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] Tactic: 7155825427510256858 time 3.29139 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] Tactic: 8918020581761223752 time 3.68154 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:55] [V] [TRT] Tactic: -8844488725130067278 time 1.4848 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] Tactic: -4756382386362004279 time 1.93754 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] Tactic: -3855385237722507464 time 3.55034 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] Tactic: -2809379259463049391 time 3.75667 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] Tactic: -504296718212024303 time 3.59565 [07/23/2021-23:46:55] [V] [TRT] Fastest Tactic: 4474630279712975759 Time: 1.0679 [07/23/2021-23:46:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CudaConvolution) [07/23/2021-23:46:55] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CublasConvolution) [07/23/2021-23:46:55] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4474630279712975759 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_indexed_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:55] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,4194304) -> Half(1,256,65536,2097152) *************** [07/23/2021-23:46:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (FusedConvActConvolution) [07/23/2021-23:46:55] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CaskConvolution) [07/23/2021-23:46:55] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CudaConvolution) [07/23/2021-23:46:55] [V] [TRT] Tactic: 0 time 4.4027 [07/23/2021-23:46:55] [V] [TRT] Tactic: 1 time 1.47008 [07/23/2021-23:46:56] [V] [TRT] Tactic: 2 time 6.00243 [07/23/2021-23:46:56] [V] [TRT] Tactic: 5 time 3.35243 [07/23/2021-23:46:56] [V] [TRT] Tactic: 6 time 1.82118 [07/23/2021-23:46:56] [V] [TRT] Tactic: 56 time 4.53798 [07/23/2021-23:46:56] [V] [TRT] Tactic: 58 time 6.12429 [07/23/2021-23:46:56] [V] [TRT] Tactic: 61 time 3.36354 [07/23/2021-23:46:56] [V] [TRT] Tactic: 62 time 1.82055 [07/23/2021-23:46:56] [V] [TRT] Fastest Tactic: 1 Time: 1.47008 [07/23/2021-23:46:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CublasConvolution) [07/23/2021-23:46:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [07/23/2021-23:46:56] [V] [TRT] [07/23/2021-23:46:56] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,2097152) -> Half(1,256,65536:2,1048576) *************** [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:46:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (FusedConvActConvolution) [07/23/2021-23:46:56] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CaskConvolution) [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:46:56] [V] [TRT] Tactic: 2195670545862694453 time 0.581504 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:46:56] [V] [TRT] Tactic: 3419182076704469245 time 1.08083 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:46:56] [V] [TRT] Tactic: 3891805945559659536 time 2.2848 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:46:56] [V] [TRT] Tactic: 5548126322150286555 time 1.10157 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:46:56] [V] [TRT] Tactic: 6057304366605292508 time 1.0912 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:46:56] [V] [TRT] Tactic: -7928611605886347652 time 2.33165 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:46:56] [V] [TRT] Tactic: -5172391392092686714 time 0.600576 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:46:56] [V] [TRT] Tactic: -4374269919094467161 time 0.589056 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:46:56] [V] [TRT] Tactic: -4083394051665370953 time 0.523144 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:46:56] [V] [TRT] Tactic: -1546027692247304867 time 2.26114 [07/23/2021-23:46:56] [V] [TRT] Fastest Tactic: -4083394051665370953 Time: 0.523144 [07/23/2021-23:46:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CudaConvolution) [07/23/2021-23:46:56] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CublasConvolution) [07/23/2021-23:46:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4083394051665370953 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:46:56] [V] [TRT] [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:46:56] [V] [TRT] *************** Autotuning format combination: Half(8,2048,1:8,524288) -> Float(1,256,65536,2097152) *************** [07/23/2021-23:46:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (FusedConvActConvolution) [07/23/2021-23:46:56] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CaskConvolution) [07/23/2021-23:46:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CudaConvolution) [07/23/2021-23:46:56] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CublasConvolution) [07/23/2021-23:46:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:56] [V] [TRT] *************** Autotuning format combination: Half(8,2048,1:8,524288) -> Half(4,1024,1:8,262144) *************** [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (FusedConvActConvolution) [07/23/2021-23:46:56] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CaskConvolution) [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] Tactic: 254850674756030979 time 0.65472 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] Tactic: 1156328698016730421 time 0.582912 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:56] [V] [TRT] Tactic: 1584305878200231339 time 0.690304 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] Tactic: 1832046141070096030 time 0.436356 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] Tactic: 1838082074606840426 time 0.44352 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:46:56] [V] [TRT] Tactic: 1899296423087490472 time 0.562688 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:56] [V] [TRT] Tactic: 2338136297163812551 time 0.688768 [07/23/2021-23:46:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 2541579301352125276 time 0.686612 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 2657157263811141609 time 0.577792 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 2819719497590964443 time 0.875392 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:57] [V] [TRT] Tactic: 2835786846016979545 time 0.483344 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 2968605903460894194 time 0.441472 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 2986078304285316765 time 0.690432 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 3362537467505018070 time 0.689024 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 3513075359009385578 time 0.659728 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:57] [V] [TRT] Tactic: 3546424067684403057 time 0.5088 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 3573559043797674382 time 0.440452 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 3704534001553878387 time 0.573316 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 4278315135102886928 time 0.787968 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:57] [V] [TRT] Tactic: 4750655167565104065 time 0.413824 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 4802447371470387646 time 0.447616 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 5059676457552313631 time 0.655744 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 5398999388616959893 time 0.40578 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:57] [V] [TRT] Tactic: 5579149726397848560 time 0.370304 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 5746691132547383910 time 0.849024 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 5770170567977052602 time 0.451584 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:57] [V] [TRT] Tactic: 5896806418498994339 time 0.311808 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 6034364043891107501 time 0.766848 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 6074229447555668232 time 0.558984 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:57] [V] [TRT] Tactic: 6176524653920166422 time 0.406272 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:57] [V] [TRT] Tactic: 6272216432116166416 time 0.702464 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 6377497238381488891 time 0.690304 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:57] [V] [TRT] Tactic: 6428823438254963239 time 0.47208 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 6446388116965632819 time 0.42688 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 6468794451065529747 time 0.453776 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 6642277870194067185 time 0.66624 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:57] [V] [TRT] Tactic: 6725284471687256210 time 0.316304 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 6859477213531075460 time 0.539008 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:57] [V] [TRT] Tactic: 7100752989500049598 time 0.32256 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 7216571380637776659 time 0.363008 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 7609923741161019135 time 0.42124 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:57] [V] [TRT] Tactic: 7667554089956651578 time 0.404132 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 7705739241028240201 time 0.580108 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:57] [V] [TRT] Tactic: 8040838497444300918 time 0.55936 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 8101703987960976805 time 0.59428 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 8170606396342855895 time 0.452224 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:57] [V] [TRT] Tactic: 8264928564315835356 time 0.3712 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: 8839784824303350101 time 0.348056 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -9217371357561775773 time 0.603136 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -9009272790678027912 time 0.452612 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -8949544755481315679 time 0.447744 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -8604374562669615024 time 0.557952 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:57] [V] [TRT] Tactic: -7938306756270351617 time 1.20602 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:57] [V] [TRT] Tactic: -7027328628217650515 time 0.684544 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -6840588038605932325 time 0.82048 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:57] [V] [TRT] Tactic: -6603588435230240365 time 1.25517 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -6356316196810535311 time 0.627712 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -6257787336162086472 time 0.60366 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -6063766379489217211 time 0.440576 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:57] [V] [TRT] Tactic: -6055152894973171263 time 0.776704 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:57] [V] [TRT] Tactic: -5634849406670564996 time 0.527744 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -5530886555766748586 time 0.684032 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:57] [V] [TRT] Tactic: -5421613452990385135 time 0.640128 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -5161596964442251102 time 0.83842 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -5127240325355316006 time 0.770828 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -4796511246675321840 time 0.860308 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -4706569565442112734 time 0.626304 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -4409144516525410768 time 0.696204 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -4379519430184503304 time 0.420224 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:57] [V] [TRT] Tactic: -4342782565153442362 time 0.633856 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:57] [V] [TRT] Tactic: -4191836638128696671 time 0.458752 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -4152066959007262150 time 0.652544 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -4021926646879732549 time 0.795264 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -3987638434926559037 time 0.864896 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:57] [V] [TRT] Tactic: -3939749857557624176 time 0.456192 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -3905653247016903130 time 0.411264 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -3895429239811098010 time 0.778752 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -3864869056275745423 time 0.438656 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -3601464762214218301 time 0.528768 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -3412636942650049698 time 0.412288 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:57] [V] [TRT] Tactic: -3058330359340425555 time 0.83456 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:57] [V] [TRT] Tactic: -2893013346565417259 time 0.743552 [07/23/2021-23:46:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:58] [V] [TRT] Tactic: -2816084650627734155 time 0.45248 [07/23/2021-23:46:58] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:58] [V] [TRT] Tactic: -2559894581585337900 time 0.656128 [07/23/2021-23:46:58] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:58] [V] [TRT] Tactic: -2241736083352441442 time 0.369536 [07/23/2021-23:46:58] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:58] [V] [TRT] Tactic: -1985778916402815946 time 0.452992 [07/23/2021-23:46:58] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:58] [V] [TRT] Tactic: -1979709471637578040 time 0.865024 [07/23/2021-23:46:58] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:58] [V] [TRT] Tactic: -1824906597022852312 time 1.22202 [07/23/2021-23:46:58] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:58] [V] [TRT] Tactic: -1727693334586194183 time 0.741632 [07/23/2021-23:46:58] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:58] [V] [TRT] Tactic: -1657270965825641606 time 0.73344 [07/23/2021-23:46:58] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:58] [V] [TRT] Tactic: -1500496213132463076 time 0.476416 [07/23/2021-23:46:58] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:58] [V] [TRT] Tactic: -1194193093145321861 time 0.544256 [07/23/2021-23:46:58] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:46:58] [V] [TRT] Tactic: -1099247066487349374 time 0.54784 [07/23/2021-23:46:58] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:58] [V] [TRT] Tactic: -705524612929044822 time 0.64448 [07/23/2021-23:46:58] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:58] [V] [TRT] Tactic: -680956411637736772 time 0.46848 [07/23/2021-23:46:58] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:58] [V] [TRT] Tactic: -504245585588397229 time 0.601984 [07/23/2021-23:46:58] [V] [TRT] Fastest Tactic: 5896806418498994339 Time: 0.311808 [07/23/2021-23:46:58] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CudaConvolution) [07/23/2021-23:46:58] [V] [TRT] Tactic: 0 time 5.856 [07/23/2021-23:46:58] [V] [TRT] Tactic: 1 time 18.0648 [07/23/2021-23:46:58] [V] [TRT] Tactic: 2 time 16.0956 [07/23/2021-23:46:58] [V] [TRT] Tactic: 6 time 1.82633 [07/23/2021-23:46:59] [V] [TRT] Tactic: 56 time 5.77178 [07/23/2021-23:46:59] [V] [TRT] Tactic: 58 time 16.1853 [07/23/2021-23:46:59] [V] [TRT] Tactic: 62 time 1.8263 [07/23/2021-23:46:59] [V] [TRT] Fastest Tactic: 62 Time: 1.8263 [07/23/2021-23:46:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CudaDepthwiseConvolution) [07/23/2021-23:46:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (CublasConvolution) [07/23/2021-23:46:59] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:46:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5896806418498994339 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:59] [V] [TRT] [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:46:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:46:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:59] [V] [TRT] Tactic: 1002 time 0.24476 [07/23/2021-23:46:59] [V] [TRT] Tactic: 0 time 0.229644 [07/23/2021-23:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.229644 [07/23/2021-23:46:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:59] [V] [TRT] Tactic: 1002 time 0.257936 [07/23/2021-23:46:59] [V] [TRT] Tactic: 0 time 0.231552 [07/23/2021-23:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.231552 [07/23/2021-23:46:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:59] [V] [TRT] Tactic: 1002 time 0.196224 [07/23/2021-23:46:59] [V] [TRT] Tactic: 0 time 0.236296 [07/23/2021-23:46:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.196224 [07/23/2021-23:46:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:59] [V] [TRT] Tactic: 1002 time 0.290048 [07/23/2021-23:46:59] [V] [TRT] Tactic: 0 time 0.166024 [07/23/2021-23:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.166024 [07/23/2021-23:46:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:59] [V] [TRT] Tactic: 1002 time 0.217856 [07/23/2021-23:46:59] [V] [TRT] Tactic: 0 time 0.173184 [07/23/2021-23:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.173184 [07/23/2021-23:46:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:59] [V] [TRT] Tactic: 1002 time 0.243968 [07/23/2021-23:46:59] [V] [TRT] Tactic: 0 time 0.92096 [07/23/2021-23:46:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.243968 [07/23/2021-23:46:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:46:59] [V] [TRT] Tactic: 1002 time 1.22342 [07/23/2021-23:46:59] [V] [TRT] Tactic: 0 time 0.22784 [07/23/2021-23:46:59] [V] [TRT] Fastest Tactic: 0 Time: 0.22784 [07/23/2021-23:46:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:00] [V] [TRT] Tactic: 1002 time 0.1824 [07/23/2021-23:47:00] [V] [TRT] Tactic: 0 time 0.811264 [07/23/2021-23:47:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.1824 [07/23/2021-23:47:00] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:00] [V] [TRT] Tactic: 1002 time 0.308352 [07/23/2021-23:47:00] [V] [TRT] Tactic: 0 time 0.932224 [07/23/2021-23:47:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.308352 [07/23/2021-23:47:00] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:00] [V] [TRT] Tactic: 1002 time 1.22291 [07/23/2021-23:47:00] [V] [TRT] Tactic: 0 time 0.165376 [07/23/2021-23:47:00] [V] [TRT] Fastest Tactic: 0 Time: 0.165376 [07/23/2021-23:47:00] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:00] [V] [TRT] Tactic: 1002 time 0.259456 [07/23/2021-23:47:00] [V] [TRT] Tactic: 0 time 0.91904 [07/23/2021-23:47:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.259456 [07/23/2021-23:47:00] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:00] [V] [TRT] Tactic: 1002 time 1.22342 [07/23/2021-23:47:00] [V] [TRT] Tactic: 0 time 0.22784 [07/23/2021-23:47:00] [V] [TRT] Fastest Tactic: 0 Time: 0.22784 [07/23/2021-23:47:00] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:00] [V] [TRT] Tactic: 1002 time 0.215808 [07/23/2021-23:47:00] [V] [TRT] Tactic: 0 time 0.81216 [07/23/2021-23:47:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.215808 [07/23/2021-23:47:00] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:00] [V] [TRT] Tactic: 1002 time 0.307072 [07/23/2021-23:47:00] [V] [TRT] Tactic: 0 time 0.931968 [07/23/2021-23:47:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.307072 [07/23/2021-23:47:00] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:00] [V] [TRT] Tactic: 1002 time 1.2224 [07/23/2021-23:47:00] [V] [TRT] Tactic: 0 time 0.169088 [07/23/2021-23:47:00] [V] [TRT] Fastest Tactic: 0 Time: 0.169088 [07/23/2021-23:47:00] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:00] [V] [TRT] Tactic: 1002 time 0.207232 [07/23/2021-23:47:00] [V] [TRT] Tactic: 0 time 0.271104 [07/23/2021-23:47:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.207232 [07/23/2021-23:47:00] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:00] [V] [TRT] Tactic: 1002 time 0.189952 [07/23/2021-23:47:00] [V] [TRT] Tactic: 0 time 0.191744 [07/23/2021-23:47:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.189952 [07/23/2021-23:47:00] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:01] [V] [TRT] Tactic: 1002 time 0.226432 [07/23/2021-23:47:01] [V] [TRT] Tactic: 0 time 0.193664 [07/23/2021-23:47:01] [V] [TRT] Fastest Tactic: 0 Time: 0.193664 [07/23/2021-23:47:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:01] [V] [TRT] Tactic: 1002 time 0.28864 [07/23/2021-23:47:01] [V] [TRT] Tactic: 0 time 0.119424 [07/23/2021-23:47:01] [V] [TRT] Fastest Tactic: 0 Time: 0.119424 [07/23/2021-23:47:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:01] [V] [TRT] Tactic: 1002 time 0.204672 [07/23/2021-23:47:01] [V] [TRT] Tactic: 0 time 0.119424 [07/23/2021-23:47:01] [V] [TRT] Fastest Tactic: 0 Time: 0.119424 [07/23/2021-23:47:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:01] [V] [TRT] Tactic: 1002 time 0.313992 [07/23/2021-23:47:01] [V] [TRT] Tactic: 0 time 0.171904 [07/23/2021-23:47:01] [V] [TRT] Fastest Tactic: 0 Time: 0.171904 [07/23/2021-23:47:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:01] [V] [TRT] Tactic: 1002 time 0.218264 [07/23/2021-23:47:01] [V] [TRT] Tactic: 0 time 0.185344 [07/23/2021-23:47:01] [V] [TRT] Fastest Tactic: 0 Time: 0.185344 [07/23/2021-23:47:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:01] [V] [TRT] Tactic: 1002 time 0.218112 [07/23/2021-23:47:01] [V] [TRT] Tactic: 0 time 0.188688 [07/23/2021-23:47:01] [V] [TRT] Fastest Tactic: 0 Time: 0.188688 [07/23/2021-23:47:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:01] [V] [TRT] Tactic: 1002 time 0.309248 [07/23/2021-23:47:01] [V] [TRT] Tactic: 0 time 0.114816 [07/23/2021-23:47:01] [V] [TRT] Fastest Tactic: 0 Time: 0.114816 [07/23/2021-23:47:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:01] [V] [TRT] Tactic: 1002 time 0.199688 [07/23/2021-23:47:01] [V] [TRT] Tactic: 0 time 0.118284 [07/23/2021-23:47:01] [V] [TRT] Fastest Tactic: 0 Time: 0.118284 [07/23/2021-23:47:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:01] [V] [TRT] Tactic: 1002 time 0.224512 [07/23/2021-23:47:01] [V] [TRT] Tactic: 0 time 0.175744 [07/23/2021-23:47:01] [V] [TRT] Fastest Tactic: 0 Time: 0.175744 [07/23/2021-23:47:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:01] [V] [TRT] Tactic: 1002 time 1.24454 [07/23/2021-23:47:01] [V] [TRT] Tactic: 0 time 0.172288 [07/23/2021-23:47:01] [V] [TRT] Fastest Tactic: 0 Time: 0.172288 [07/23/2021-23:47:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:01] [V] [TRT] Tactic: 1002 time 1.24544 [07/23/2021-23:47:01] [V] [TRT] Tactic: 0 time 0.175232 [07/23/2021-23:47:01] [V] [TRT] Fastest Tactic: 0 Time: 0.175232 [07/23/2021-23:47:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:02] [V] [TRT] Tactic: 1002 time 0.202624 [07/23/2021-23:47:02] [V] [TRT] Tactic: 0 time 0.117248 [07/23/2021-23:47:02] [V] [TRT] Fastest Tactic: 0 Time: 0.117248 [07/23/2021-23:47:02] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:47:02] [V] [TRT] Tactic: 1002 time 0.282112 [07/23/2021-23:47:02] [V] [TRT] Tactic: 0 time 0.117888 [07/23/2021-23:47:02] [V] [TRT] Fastest Tactic: 0 Time: 0.117888 [07/23/2021-23:47:02] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,2097152) -> Float(1,258,66564,2130048) *************** [07/23/2021-23:47:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:02] [V] [TRT] Tactic: 0 time 2.40691 [07/23/2021-23:47:02] [V] [TRT] Tactic: 1 time 0.921472 [07/23/2021-23:47:02] [V] [TRT] Tactic: 3 time 2.0388 [07/23/2021-23:47:02] [V] [TRT] Tactic: 4 time 0.874376 [07/23/2021-23:47:02] [V] [TRT] Tactic: 5 time 2.81331 [07/23/2021-23:47:02] [V] [TRT] Fastest Tactic: 4 Time: 0.874376 [07/23/2021-23:47:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:02] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:02] [V] [TRT] Tactic: 0 time 2.83853 [07/23/2021-23:47:02] [V] [TRT] Fastest Tactic: 0 Time: 2.83853 [07/23/2021-23:47:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 4 [07/23/2021-23:47:02] [V] [TRT] [07/23/2021-23:47:02] [V] [TRT] *************** Autotuning format combination: Float(32,8192,1,2097152) -> Float(32,8256,1,2130048) *************** [07/23/2021-23:47:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:02] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:02] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:02] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:02] [V] [TRT] *************** Autotuning format combination: Float(8,2048,1:4,524288) -> Float(8,2064,1:4,532512) *************** [07/23/2021-23:47:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:02] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:02] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:02] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:02] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,2097152) -> Half(1,258,66564,2130048) *************** [07/23/2021-23:47:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:02] [V] [TRT] Tactic: 0 time 4.53056 [07/23/2021-23:47:02] [V] [TRT] Tactic: 1 time 1.7344 [07/23/2021-23:47:02] [V] [TRT] Tactic: 3 time 1.98926 [07/23/2021-23:47:02] [V] [TRT] Tactic: 4 time 1.24403 [07/23/2021-23:47:02] [V] [TRT] Tactic: 5 time 2.66778 [07/23/2021-23:47:02] [V] [TRT] Fastest Tactic: 4 Time: 1.24403 [07/23/2021-23:47:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:02] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:02] [V] [TRT] Tactic: 0 time 1.95726 [07/23/2021-23:47:02] [V] [TRT] Fastest Tactic: 0 Time: 1.95726 [07/23/2021-23:47:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 4 [07/23/2021-23:47:02] [V] [TRT] [07/23/2021-23:47:02] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,1048576) -> Half(1,258,66564:2,1065024) *************** [07/23/2021-23:47:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:02] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:02] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:02] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:02] [V] [TRT] *************** Autotuning format combination: Half(4,1024,1:8,262144) -> Half(4,1032,1:8,266256) *************** [07/23/2021-23:47:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:02] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:02] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:03] [V] [TRT] Tactic: 0 time 1.37882 [07/23/2021-23:47:03] [V] [TRT] Fastest Tactic: 0 Time: 1.37882 [07/23/2021-23:47:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: GemmDeconvolution Tactic: 0 [07/23/2021-23:47:03] [V] [TRT] [07/23/2021-23:47:03] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:03] [V] [TRT] Tactic: 1002 time 0.278276 [07/23/2021-23:47:03] [V] [TRT] Tactic: 0 time 0.230272 [07/23/2021-23:47:03] [V] [TRT] Fastest Tactic: 0 Time: 0.230272 [07/23/2021-23:47:03] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:03] [V] [TRT] Tactic: 1002 time 0.259724 [07/23/2021-23:47:03] [V] [TRT] Tactic: 0 time 0.232832 [07/23/2021-23:47:03] [V] [TRT] Fastest Tactic: 0 Time: 0.232832 [07/23/2021-23:47:03] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:03] [V] [TRT] Tactic: 1002 time 0.275968 [07/23/2021-23:47:03] [V] [TRT] Tactic: 0 time 0.234112 [07/23/2021-23:47:03] [V] [TRT] Fastest Tactic: 0 Time: 0.234112 [07/23/2021-23:47:03] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:03] [V] [TRT] Tactic: 1002 time 0.215424 [07/23/2021-23:47:03] [V] [TRT] Tactic: 0 time 0.165888 [07/23/2021-23:47:03] [V] [TRT] Fastest Tactic: 0 Time: 0.165888 [07/23/2021-23:47:03] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:03] [V] [TRT] Tactic: 1002 time 0.306192 [07/23/2021-23:47:03] [V] [TRT] Tactic: 0 time 0.166912 [07/23/2021-23:47:03] [V] [TRT] Fastest Tactic: 0 Time: 0.166912 [07/23/2021-23:47:03] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:03] [V] [TRT] Tactic: 1002 time 0.242048 [07/23/2021-23:47:03] [V] [TRT] Tactic: 0 time 0.185344 [07/23/2021-23:47:03] [V] [TRT] Fastest Tactic: 0 Time: 0.185344 [07/23/2021-23:47:03] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:03] [V] [TRT] Tactic: 1002 time 0.244864 [07/23/2021-23:47:03] [V] [TRT] Tactic: 0 time 0.94336 [07/23/2021-23:47:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.244864 [07/23/2021-23:47:03] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:03] [V] [TRT] Tactic: 1002 time 0.266368 [07/23/2021-23:47:03] [V] [TRT] Tactic: 0 time 0.230016 [07/23/2021-23:47:03] [V] [TRT] Fastest Tactic: 0 Time: 0.230016 [07/23/2021-23:47:03] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:03] [V] [TRT] Tactic: 1002 time 1.79955 [07/23/2021-23:47:03] [V] [TRT] Tactic: 0 time 0.230272 [07/23/2021-23:47:03] [V] [TRT] Fastest Tactic: 0 Time: 0.230272 [07/23/2021-23:47:03] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:04] [V] [TRT] Tactic: 1002 time 0.187268 [07/23/2021-23:47:04] [V] [TRT] Tactic: 0 time 0.834176 [07/23/2021-23:47:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.187268 [07/23/2021-23:47:04] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:04] [V] [TRT] Tactic: 1002 time 0.321664 [07/23/2021-23:47:04] [V] [TRT] Tactic: 0 time 0.954624 [07/23/2021-23:47:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.321664 [07/23/2021-23:47:04] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:04] [V] [TRT] Tactic: 1002 time 1.80147 [07/23/2021-23:47:04] [V] [TRT] Tactic: 0 time 0.166144 [07/23/2021-23:47:04] [V] [TRT] Fastest Tactic: 0 Time: 0.166144 [07/23/2021-23:47:04] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:04] [V] [TRT] Tactic: 1002 time 0.265728 [07/23/2021-23:47:04] [V] [TRT] Tactic: 0 time 0.941568 [07/23/2021-23:47:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.265728 [07/23/2021-23:47:04] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:04] [V] [TRT] Tactic: 1002 time 1.79955 [07/23/2021-23:47:04] [V] [TRT] Tactic: 0 time 0.22976 [07/23/2021-23:47:04] [V] [TRT] Fastest Tactic: 0 Time: 0.22976 [07/23/2021-23:47:04] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:04] [V] [TRT] Tactic: 1002 time 1.808 [07/23/2021-23:47:04] [V] [TRT] Tactic: 0 time 0.228992 [07/23/2021-23:47:04] [V] [TRT] Fastest Tactic: 0 Time: 0.228992 [07/23/2021-23:47:04] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:04] [V] [TRT] Tactic: 1002 time 0.237056 [07/23/2021-23:47:04] [V] [TRT] Tactic: 0 time 0.834048 [07/23/2021-23:47:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.237056 [07/23/2021-23:47:04] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:04] [V] [TRT] Tactic: 1002 time 0.322048 [07/23/2021-23:47:04] [V] [TRT] Tactic: 0 time 0.95488 [07/23/2021-23:47:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.322048 [07/23/2021-23:47:04] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:04] [V] [TRT] Tactic: 1002 time 1.80134 [07/23/2021-23:47:04] [V] [TRT] Tactic: 0 time 0.169344 [07/23/2021-23:47:04] [V] [TRT] Fastest Tactic: 0 Time: 0.169344 [07/23/2021-23:47:04] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:04] [V] [TRT] Tactic: 1002 time 0.228096 [07/23/2021-23:47:04] [V] [TRT] Tactic: 0 time 0.172288 [07/23/2021-23:47:04] [V] [TRT] Fastest Tactic: 0 Time: 0.172288 [07/23/2021-23:47:04] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:05] [V] [TRT] Tactic: 1002 time 0.195712 [07/23/2021-23:47:05] [V] [TRT] Tactic: 0 time 0.191488 [07/23/2021-23:47:05] [V] [TRT] Fastest Tactic: 0 Time: 0.191488 [07/23/2021-23:47:05] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:05] [V] [TRT] Tactic: 1002 time 0.246656 [07/23/2021-23:47:05] [V] [TRT] Tactic: 0 time 0.19392 [07/23/2021-23:47:05] [V] [TRT] Fastest Tactic: 0 Time: 0.19392 [07/23/2021-23:47:05] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:05] [V] [TRT] Tactic: 1002 time 0.178304 [07/23/2021-23:47:05] [V] [TRT] Tactic: 0 time 0.123136 [07/23/2021-23:47:05] [V] [TRT] Fastest Tactic: 0 Time: 0.123136 [07/23/2021-23:47:05] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:05] [V] [TRT] Tactic: 1002 time 0.307072 [07/23/2021-23:47:05] [V] [TRT] Tactic: 0 time 0.131712 [07/23/2021-23:47:05] [V] [TRT] Fastest Tactic: 0 Time: 0.131712 [07/23/2021-23:47:05] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:05] [V] [TRT] Tactic: 1002 time 0.23744 [07/23/2021-23:47:05] [V] [TRT] Tactic: 0 time 0.15424 [07/23/2021-23:47:05] [V] [TRT] Fastest Tactic: 0 Time: 0.15424 [07/23/2021-23:47:05] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:05] [V] [TRT] Tactic: 1002 time 0.363008 [07/23/2021-23:47:05] [V] [TRT] Tactic: 0 time 0.170496 [07/23/2021-23:47:05] [V] [TRT] Fastest Tactic: 0 Time: 0.170496 [07/23/2021-23:47:05] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:05] [V] [TRT] Tactic: 1002 time 0.237824 [07/23/2021-23:47:05] [V] [TRT] Tactic: 0 time 0.185984 [07/23/2021-23:47:05] [V] [TRT] Fastest Tactic: 0 Time: 0.185984 [07/23/2021-23:47:05] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:05] [V] [TRT] Tactic: 1002 time 0.238336 [07/23/2021-23:47:05] [V] [TRT] Tactic: 0 time 0.189312 [07/23/2021-23:47:05] [V] [TRT] Fastest Tactic: 0 Time: 0.189312 [07/23/2021-23:47:05] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:05] [V] [TRT] Tactic: 1002 time 0.358272 [07/23/2021-23:47:05] [V] [TRT] Tactic: 0 time 0.127488 [07/23/2021-23:47:05] [V] [TRT] Fastest Tactic: 0 Time: 0.127488 [07/23/2021-23:47:05] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:05] [V] [TRT] Tactic: 1002 time 0.30272 [07/23/2021-23:47:05] [V] [TRT] Tactic: 0 time 0.11712 [07/23/2021-23:47:05] [V] [TRT] Fastest Tactic: 0 Time: 0.11712 [07/23/2021-23:47:05] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:05] [V] [TRT] Tactic: 1002 time 0.234112 [07/23/2021-23:47:05] [V] [TRT] Tactic: 0 time 0.15744 [07/23/2021-23:47:05] [V] [TRT] Fastest Tactic: 0 Time: 0.15744 [07/23/2021-23:47:05] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:06] [V] [TRT] Tactic: 1002 time 0.24064 [07/23/2021-23:47:06] [V] [TRT] Tactic: 0 time 0.322052 [07/23/2021-23:47:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.24064 [07/23/2021-23:47:06] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:06] [V] [TRT] Tactic: 1002 time 1.81734 [07/23/2021-23:47:06] [V] [TRT] Tactic: 0 time 0.174336 [07/23/2021-23:47:06] [V] [TRT] Fastest Tactic: 0 Time: 0.174336 [07/23/2021-23:47:06] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:06] [V] [TRT] Tactic: 1002 time 1.82285 [07/23/2021-23:47:06] [V] [TRT] Tactic: 0 time 0.1769 [07/23/2021-23:47:06] [V] [TRT] Fastest Tactic: 0 Time: 0.1769 [07/23/2021-23:47:06] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:06] [V] [TRT] Tactic: 1002 time 0.23616 [07/23/2021-23:47:06] [V] [TRT] Tactic: 0 time 0.242688 [07/23/2021-23:47:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.23616 [07/23/2021-23:47:06] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:06] [V] [TRT] Tactic: 1002 time 0.297856 [07/23/2021-23:47:06] [V] [TRT] Tactic: 0 time 0.24384 [07/23/2021-23:47:06] [V] [TRT] Fastest Tactic: 0 Time: 0.24384 [07/23/2021-23:47:06] [V] [TRT] --------------- Timing Runner: Slice__95 (Reformat) [07/23/2021-23:47:06] [V] [TRT] Tactic: 1002 time 1.8249 [07/23/2021-23:47:06] [V] [TRT] Tactic: 0 time 0.117248 [07/23/2021-23:47:06] [V] [TRT] Fastest Tactic: 0 Time: 0.117248 [07/23/2021-23:47:08] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,2097152) -> Float(1,256,65536,2097152) *************** [07/23/2021-23:47:08] [V] [TRT] --------------- Timing Runner: const_fold_opt__478 + StatefulPartitionedCall/model/conv2d_transpose/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose/Relu (Scale) [07/23/2021-23:47:08] [V] [TRT] Tactic: 0 time 0.229632 [07/23/2021-23:47:08] [V] [TRT] Fastest Tactic: 0 Time: 0.229632 [07/23/2021-23:47:08] [V] [TRT] *************** Autotuning format combination: Float(32,8192,1,2097152) -> Float(32,8192,1,2097152) *************** [07/23/2021-23:47:08] [V] [TRT] --------------- Timing Runner: const_fold_opt__478 + StatefulPartitionedCall/model/conv2d_transpose/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose/Relu (Scale) [07/23/2021-23:47:08] [V] [TRT] Scale has no valid tactics for this config, skipping [07/23/2021-23:47:08] [V] [TRT] *************** Autotuning format combination: Float(8,2048,1:4,524288) -> Float(8,2048,1:4,524288) *************** [07/23/2021-23:47:08] [V] [TRT] --------------- Timing Runner: const_fold_opt__478 + StatefulPartitionedCall/model/conv2d_transpose/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose/Relu (Scale) [07/23/2021-23:47:08] [V] [TRT] Scale has no valid tactics for this config, skipping [07/23/2021-23:47:08] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,2097152) -> Half(1,256,65536,2097152) *************** [07/23/2021-23:47:08] [V] [TRT] --------------- Timing Runner: const_fold_opt__478 + StatefulPartitionedCall/model/conv2d_transpose/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose/Relu (Scale) [07/23/2021-23:47:09] [V] [TRT] Tactic: 0 time 0.116864 [07/23/2021-23:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.116864 [07/23/2021-23:47:09] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,1048576) -> Half(1,256,65536:2,1048576) *************** [07/23/2021-23:47:09] [V] [TRT] --------------- Timing Runner: const_fold_opt__478 + StatefulPartitionedCall/model/conv2d_transpose/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose/Relu (Scale) [07/23/2021-23:47:09] [V] [TRT] Tactic: 0 time 0.11776 [07/23/2021-23:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.11776 [07/23/2021-23:47:09] [V] [TRT] *************** Autotuning format combination: Half(4,1024,1:8,262144) -> Half(4,1024,1:8,262144) *************** [07/23/2021-23:47:09] [V] [TRT] --------------- Timing Runner: const_fold_opt__478 + StatefulPartitionedCall/model/conv2d_transpose/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose/Relu (Scale) [07/23/2021-23:47:09] [V] [TRT] Tactic: 0 time 0.116864 [07/23/2021-23:47:09] [V] [TRT] Fastest Tactic: 0 Time: 0.116864 [07/23/2021-23:47:11] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,2097152) -> Float(1,258,66564,4260096) *************** [07/23/2021-23:47:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:11] [V] [TRT] Tactic: 0 time 5.0624 [07/23/2021-23:47:11] [V] [TRT] Tactic: 1 time 1.30227 [07/23/2021-23:47:11] [V] [TRT] Tactic: 3 time 3.2732 [07/23/2021-23:47:11] [V] [TRT] Tactic: 4 time 1.58299 [07/23/2021-23:47:11] [V] [TRT] Tactic: 5 time 3.94778 [07/23/2021-23:47:11] [V] [TRT] Fastest Tactic: 1 Time: 1.30227 [07/23/2021-23:47:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:11] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:11] [V] [TRT] Tactic: 0 time 3.69053 [07/23/2021-23:47:11] [V] [TRT] Fastest Tactic: 0 Time: 3.69053 [07/23/2021-23:47:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 1 [07/23/2021-23:47:11] [V] [TRT] [07/23/2021-23:47:11] [V] [TRT] *************** Autotuning format combination: Float(32,8192,1,2097152) -> Float(64,16512,1,4260096) *************** [07/23/2021-23:47:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:11] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:11] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:11] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:11] [V] [TRT] *************** Autotuning format combination: Float(8,2048,1:4,524288) -> Float(16,4128,1:4,1065024) *************** [07/23/2021-23:47:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:11] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:11] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:11] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:11] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,2097152) -> Half(1,258,66564,4260096) *************** [07/23/2021-23:47:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:12] [V] [TRT] Tactic: 0 time 9.07418 [07/23/2021-23:47:12] [V] [TRT] Tactic: 1 time 1.73645 [07/23/2021-23:47:12] [V] [TRT] Tactic: 3 time 2.98547 [07/23/2021-23:47:12] [V] [TRT] Tactic: 4 time 2.09766 [07/23/2021-23:47:12] [V] [TRT] Tactic: 5 time 3.7239 [07/23/2021-23:47:12] [V] [TRT] Fastest Tactic: 1 Time: 1.73645 [07/23/2021-23:47:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:12] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:12] [V] [TRT] Tactic: 0 time 2.50074 [07/23/2021-23:47:12] [V] [TRT] Fastest Tactic: 0 Time: 2.50074 [07/23/2021-23:47:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 1 [07/23/2021-23:47:12] [V] [TRT] [07/23/2021-23:47:12] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,1048576) -> Half(1,258,66564:2,2130048) *************** [07/23/2021-23:47:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:12] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:12] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:12] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:12] [V] [TRT] *************** Autotuning format combination: Half(4,1024,1:8,262144) -> Half(8,2064,1:8,532512) *************** [07/23/2021-23:47:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:12] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:12] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:12] [V] [TRT] Tactic: 0 time 1.56096 [07/23/2021-23:47:12] [V] [TRT] Fastest Tactic: 0 Time: 1.56096 [07/23/2021-23:47:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: GemmDeconvolution Tactic: 0 [07/23/2021-23:47:12] [V] [TRT] [07/23/2021-23:47:12] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:12] [V] [TRT] Tactic: 1002 time 0.550784 [07/23/2021-23:47:12] [V] [TRT] Tactic: 0 time 0.456328 [07/23/2021-23:47:12] [V] [TRT] Fastest Tactic: 0 Time: 0.456328 [07/23/2021-23:47:12] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:12] [V] [TRT] Tactic: 1002 time 0.536472 [07/23/2021-23:47:12] [V] [TRT] Tactic: 0 time 0.486656 [07/23/2021-23:47:12] [V] [TRT] Fastest Tactic: 0 Time: 0.486656 [07/23/2021-23:47:12] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:12] [V] [TRT] Tactic: 1002 time 0.553472 [07/23/2021-23:47:12] [V] [TRT] Tactic: 0 time 0.4868 [07/23/2021-23:47:12] [V] [TRT] Fastest Tactic: 0 Time: 0.4868 [07/23/2021-23:47:12] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:13] [V] [TRT] Tactic: 1002 time 0.429568 [07/23/2021-23:47:13] [V] [TRT] Tactic: 0 time 0.32576 [07/23/2021-23:47:13] [V] [TRT] Fastest Tactic: 0 Time: 0.32576 [07/23/2021-23:47:13] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:13] [V] [TRT] Tactic: 1002 time 0.592896 [07/23/2021-23:47:13] [V] [TRT] Tactic: 0 time 0.327936 [07/23/2021-23:47:13] [V] [TRT] Fastest Tactic: 0 Time: 0.327936 [07/23/2021-23:47:13] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:13] [V] [TRT] Tactic: 1002 time 0.47744 [07/23/2021-23:47:13] [V] [TRT] Tactic: 0 time 0.395264 [07/23/2021-23:47:13] [V] [TRT] Fastest Tactic: 0 Time: 0.395264 [07/23/2021-23:47:13] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:13] [V] [TRT] Tactic: 1002 time 0.49448 [07/23/2021-23:47:13] [V] [TRT] Tactic: 0 time 2.20685 [07/23/2021-23:47:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.49448 [07/23/2021-23:47:13] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:13] [V] [TRT] Tactic: 1002 time 0.517264 [07/23/2021-23:47:13] [V] [TRT] Tactic: 0 time 0.452608 [07/23/2021-23:47:13] [V] [TRT] Fastest Tactic: 0 Time: 0.452608 [07/23/2021-23:47:13] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:13] [V] [TRT] Tactic: 1002 time 1.80326 [07/23/2021-23:47:13] [V] [TRT] Tactic: 0 time 0.450832 [07/23/2021-23:47:13] [V] [TRT] Fastest Tactic: 0 Time: 0.450832 [07/23/2021-23:47:13] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:13] [V] [TRT] Tactic: 1002 time 0.382976 [07/23/2021-23:47:13] [V] [TRT] Tactic: 0 time 2.016 [07/23/2021-23:47:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.382976 [07/23/2021-23:47:13] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:13] [V] [TRT] Tactic: 1002 time 0.643712 [07/23/2021-23:47:13] [V] [TRT] Tactic: 0 time 2.24435 [07/23/2021-23:47:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.643712 [07/23/2021-23:47:13] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:13] [V] [TRT] Tactic: 1002 time 1.80506 [07/23/2021-23:47:13] [V] [TRT] Tactic: 0 time 0.327808 [07/23/2021-23:47:13] [V] [TRT] Fastest Tactic: 0 Time: 0.327808 [07/23/2021-23:47:13] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:14] [V] [TRT] Tactic: 1002 time 0.536064 [07/23/2021-23:47:14] [V] [TRT] Tactic: 0 time 2.19277 [07/23/2021-23:47:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.536064 [07/23/2021-23:47:14] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:14] [V] [TRT] Tactic: 1002 time 1.8112 [07/23/2021-23:47:14] [V] [TRT] Tactic: 0 time 0.451968 [07/23/2021-23:47:14] [V] [TRT] Fastest Tactic: 0 Time: 0.451968 [07/23/2021-23:47:14] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:14] [V] [TRT] Tactic: 1002 time 1.80493 [07/23/2021-23:47:14] [V] [TRT] Tactic: 0 time 0.451072 [07/23/2021-23:47:14] [V] [TRT] Fastest Tactic: 0 Time: 0.451072 [07/23/2021-23:47:14] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:14] [V] [TRT] Tactic: 1002 time 0.469888 [07/23/2021-23:47:14] [V] [TRT] Tactic: 0 time 2.00768 [07/23/2021-23:47:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.469888 [07/23/2021-23:47:14] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:14] [V] [TRT] Tactic: 1002 time 0.641152 [07/23/2021-23:47:14] [V] [TRT] Tactic: 0 time 2.24371 [07/23/2021-23:47:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.641152 [07/23/2021-23:47:14] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:14] [V] [TRT] Tactic: 1002 time 1.80467 [07/23/2021-23:47:14] [V] [TRT] Tactic: 0 time 0.335104 [07/23/2021-23:47:14] [V] [TRT] Fastest Tactic: 0 Time: 0.335104 [07/23/2021-23:47:14] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:14] [V] [TRT] Tactic: 1002 time 0.45312 [07/23/2021-23:47:14] [V] [TRT] Tactic: 0 time 0.339072 [07/23/2021-23:47:14] [V] [TRT] Fastest Tactic: 0 Time: 0.339072 [07/23/2021-23:47:14] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:14] [V] [TRT] Tactic: 1002 time 0.405248 [07/23/2021-23:47:14] [V] [TRT] Tactic: 0 time 0.415488 [07/23/2021-23:47:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.405248 [07/23/2021-23:47:14] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:14] [V] [TRT] Tactic: 1002 time 0.484992 [07/23/2021-23:47:14] [V] [TRT] Tactic: 0 time 0.418816 [07/23/2021-23:47:14] [V] [TRT] Fastest Tactic: 0 Time: 0.418816 [07/23/2021-23:47:14] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:15] [V] [TRT] Tactic: 1002 time 0.35456 [07/23/2021-23:47:15] [V] [TRT] Tactic: 0 time 0.24128 [07/23/2021-23:47:15] [V] [TRT] Fastest Tactic: 0 Time: 0.24128 [07/23/2021-23:47:15] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:15] [V] [TRT] Tactic: 1002 time 0.591232 [07/23/2021-23:47:15] [V] [TRT] Tactic: 0 time 0.258432 [07/23/2021-23:47:15] [V] [TRT] Fastest Tactic: 0 Time: 0.258432 [07/23/2021-23:47:15] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:15] [V] [TRT] Tactic: 1002 time 0.470016 [07/23/2021-23:47:15] [V] [TRT] Tactic: 0 time 0.353152 [07/23/2021-23:47:15] [V] [TRT] Fastest Tactic: 0 Time: 0.353152 [07/23/2021-23:47:15] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:15] [V] [TRT] Tactic: 1002 time 0.719232 [07/23/2021-23:47:15] [V] [TRT] Tactic: 0 time 0.33536 [07/23/2021-23:47:15] [V] [TRT] Fastest Tactic: 0 Time: 0.33536 [07/23/2021-23:47:15] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:15] [V] [TRT] Tactic: 1002 time 0.470912 [07/23/2021-23:47:15] [V] [TRT] Tactic: 0 time 0.379008 [07/23/2021-23:47:15] [V] [TRT] Fastest Tactic: 0 Time: 0.379008 [07/23/2021-23:47:15] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:15] [V] [TRT] Tactic: 1002 time 0.47104 [07/23/2021-23:47:15] [V] [TRT] Tactic: 0 time 0.385284 [07/23/2021-23:47:15] [V] [TRT] Fastest Tactic: 0 Time: 0.385284 [07/23/2021-23:47:15] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:15] [V] [TRT] Tactic: 1002 time 0.709504 [07/23/2021-23:47:15] [V] [TRT] Tactic: 0 time 0.249984 [07/23/2021-23:47:15] [V] [TRT] Fastest Tactic: 0 Time: 0.249984 [07/23/2021-23:47:15] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:15] [V] [TRT] Tactic: 1002 time 0.580224 [07/23/2021-23:47:15] [V] [TRT] Tactic: 0 time 0.2304 [07/23/2021-23:47:15] [V] [TRT] Fastest Tactic: 0 Time: 0.2304 [07/23/2021-23:47:15] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:15] [V] [TRT] Tactic: 1002 time 0.462976 [07/23/2021-23:47:15] [V] [TRT] Tactic: 0 time 0.316544 [07/23/2021-23:47:15] [V] [TRT] Fastest Tactic: 0 Time: 0.316544 [07/23/2021-23:47:15] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:15] [V] [TRT] Tactic: 1002 time 0.478848 [07/23/2021-23:47:15] [V] [TRT] Tactic: 0 time 1.84422 [07/23/2021-23:47:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.478848 [07/23/2021-23:47:15] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:16] [V] [TRT] Tactic: 1002 time 1.81939 [07/23/2021-23:47:16] [V] [TRT] Tactic: 0 time 0.3424 [07/23/2021-23:47:16] [V] [TRT] Fastest Tactic: 0 Time: 0.3424 [07/23/2021-23:47:16] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:16] [V] [TRT] Tactic: 1002 time 1.82874 [07/23/2021-23:47:16] [V] [TRT] Tactic: 0 time 0.348672 [07/23/2021-23:47:16] [V] [TRT] Fastest Tactic: 0 Time: 0.348672 [07/23/2021-23:47:16] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:16] [V] [TRT] Tactic: 1002 time 0.468736 [07/23/2021-23:47:16] [V] [TRT] Tactic: 0 time 1.62778 [07/23/2021-23:47:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.468736 [07/23/2021-23:47:16] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:16] [V] [TRT] Tactic: 1002 time 0.601856 [07/23/2021-23:47:16] [V] [TRT] Tactic: 0 time 1.8775 [07/23/2021-23:47:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.601856 [07/23/2021-23:47:16] [V] [TRT] --------------- Timing Runner: Slice__157 (Reformat) [07/23/2021-23:47:16] [V] [TRT] Tactic: 1002 time 1.82234 [07/23/2021-23:47:16] [V] [TRT] Tactic: 0 time 0.229888 [07/23/2021-23:47:16] [V] [TRT] Fastest Tactic: 0 Time: 0.229888 [07/23/2021-23:47:18] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,4194304) -> Float(1,256,65536,4194304) *************** [07/23/2021-23:47:18] [V] [TRT] --------------- Timing Runner: const_fold_opt__475 + StatefulPartitionedCall/model/conv2d_transpose_1/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_1/Relu (Scale) [07/23/2021-23:47:18] [V] [TRT] Tactic: 0 time 0.453632 [07/23/2021-23:47:18] [V] [TRT] Fastest Tactic: 0 Time: 0.453632 [07/23/2021-23:47:18] [V] [TRT] *************** Autotuning format combination: Float(64,16384,1,4194304) -> Float(64,16384,1,4194304) *************** [07/23/2021-23:47:18] [V] [TRT] --------------- Timing Runner: const_fold_opt__475 + StatefulPartitionedCall/model/conv2d_transpose_1/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_1/Relu (Scale) [07/23/2021-23:47:18] [V] [TRT] Scale has no valid tactics for this config, skipping [07/23/2021-23:47:18] [V] [TRT] *************** Autotuning format combination: Float(16,4096,1:4,1048576) -> Float(16,4096,1:4,1048576) *************** [07/23/2021-23:47:18] [V] [TRT] --------------- Timing Runner: const_fold_opt__475 + StatefulPartitionedCall/model/conv2d_transpose_1/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_1/Relu (Scale) [07/23/2021-23:47:18] [V] [TRT] Scale has no valid tactics for this config, skipping [07/23/2021-23:47:19] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,4194304) -> Half(1,256,65536,4194304) *************** [07/23/2021-23:47:19] [V] [TRT] --------------- Timing Runner: const_fold_opt__475 + StatefulPartitionedCall/model/conv2d_transpose_1/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_1/Relu (Scale) [07/23/2021-23:47:19] [V] [TRT] Tactic: 0 time 0.22912 [07/23/2021-23:47:19] [V] [TRT] Fastest Tactic: 0 Time: 0.22912 [07/23/2021-23:47:19] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,2097152) -> Half(1,256,65536:2,2097152) *************** [07/23/2021-23:47:19] [V] [TRT] --------------- Timing Runner: const_fold_opt__475 + StatefulPartitionedCall/model/conv2d_transpose_1/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_1/Relu (Scale) [07/23/2021-23:47:19] [V] [TRT] Tactic: 0 time 0.228736 [07/23/2021-23:47:19] [V] [TRT] Fastest Tactic: 0 Time: 0.228736 [07/23/2021-23:47:19] [V] [TRT] *************** Autotuning format combination: Half(8,2048,1:8,524288) -> Half(8,2048,1:8,524288) *************** [07/23/2021-23:47:19] [V] [TRT] --------------- Timing Runner: const_fold_opt__475 + StatefulPartitionedCall/model/conv2d_transpose_1/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_1/Relu (Scale) [07/23/2021-23:47:19] [V] [TRT] Tactic: 0 time 0.22848 [07/23/2021-23:47:19] [V] [TRT] Fastest Tactic: 0 Time: 0.22848 [07/23/2021-23:47:21] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,4194304) -> Float(1,258,66564,8520192) *************** [07/23/2021-23:47:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:21] [V] [TRT] Tactic: 0 time 11.0839 [07/23/2021-23:47:21] [V] [TRT] Tactic: 1 time 2.95077 [07/23/2021-23:47:22] [V] [TRT] Tactic: 3 time 8.77086 [07/23/2021-23:47:22] [V] [TRT] Tactic: 4 time 3.87442 [07/23/2021-23:47:22] [V] [TRT] Tactic: 5 time 7.91911 [07/23/2021-23:47:22] [V] [TRT] Fastest Tactic: 1 Time: 2.95077 [07/23/2021-23:47:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:22] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:22] [V] [TRT] Tactic: 0 time 9.41926 [07/23/2021-23:47:22] [V] [TRT] Fastest Tactic: 0 Time: 9.41926 [07/23/2021-23:47:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 1 [07/23/2021-23:47:22] [V] [TRT] [07/23/2021-23:47:22] [V] [TRT] *************** Autotuning format combination: Float(64,16384,1,4194304) -> Float(128,33024,1,8520192) *************** [07/23/2021-23:47:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:22] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:22] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:22] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:22] [V] [TRT] *************** Autotuning format combination: Float(16,4096,1:4,1048576) -> Float(32,8256,1:4,2130048) *************** [07/23/2021-23:47:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:22] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:22] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:22] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:22] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,4194304) -> Half(1,258,66564,8520192) *************** [07/23/2021-23:47:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:22] [V] [TRT] Tactic: 0 time 19.2326 [07/23/2021-23:47:23] [V] [TRT] Tactic: 1 time 3.43527 [07/23/2021-23:47:23] [V] [TRT] Tactic: 3 time 8.35403 [07/23/2021-23:47:23] [V] [TRT] Tactic: 4 time 5.01066 [07/23/2021-23:47:23] [V] [TRT] Tactic: 5 time 7.4693 [07/23/2021-23:47:23] [V] [TRT] Fastest Tactic: 1 Time: 3.43527 [07/23/2021-23:47:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:23] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:23] [V] [TRT] Tactic: 0 time 5.49478 [07/23/2021-23:47:23] [V] [TRT] Fastest Tactic: 0 Time: 5.49478 [07/23/2021-23:47:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 1 [07/23/2021-23:47:23] [V] [TRT] [07/23/2021-23:47:23] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,2097152) -> Half(1,258,66564:2,4260096) *************** [07/23/2021-23:47:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:23] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:23] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:23] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:23] [V] [TRT] *************** Autotuning format combination: Half(8,2048,1:8,524288) -> Half(16,4128,1:8,1065024) *************** [07/23/2021-23:47:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:23] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:23] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:23] [V] [TRT] Tactic: 0 time 2.9536 [07/23/2021-23:47:23] [V] [TRT] Fastest Tactic: 0 Time: 2.9536 [07/23/2021-23:47:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: GemmDeconvolution Tactic: 0 [07/23/2021-23:47:23] [V] [TRT] [07/23/2021-23:47:23] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:23] [V] [TRT] Tactic: 1002 time 1.10413 [07/23/2021-23:47:23] [V] [TRT] Tactic: 0 time 0.907392 [07/23/2021-23:47:23] [V] [TRT] Fastest Tactic: 0 Time: 0.907392 [07/23/2021-23:47:23] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:23] [V] [TRT] Tactic: 1002 time 1.08736 [07/23/2021-23:47:23] [V] [TRT] Tactic: 0 time 1.54163 [07/23/2021-23:47:23] [V] [TRT] Fastest Tactic: 1002 Time: 1.08736 [07/23/2021-23:47:23] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:24] [V] [TRT] Tactic: 1002 time 1.12987 [07/23/2021-23:47:24] [V] [TRT] Tactic: 0 time 1.50426 [07/23/2021-23:47:24] [V] [TRT] Fastest Tactic: 1002 Time: 1.12987 [07/23/2021-23:47:24] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:24] [V] [TRT] Tactic: 1002 time 0.858496 [07/23/2021-23:47:24] [V] [TRT] Tactic: 0 time 0.646144 [07/23/2021-23:47:24] [V] [TRT] Fastest Tactic: 0 Time: 0.646144 [07/23/2021-23:47:24] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:24] [V] [TRT] Tactic: 1002 time 1.1808 [07/23/2021-23:47:24] [V] [TRT] Tactic: 0 time 0.651392 [07/23/2021-23:47:24] [V] [TRT] Fastest Tactic: 0 Time: 0.651392 [07/23/2021-23:47:24] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:24] [V] [TRT] Tactic: 1002 time 0.96 [07/23/2021-23:47:24] [V] [TRT] Tactic: 0 time 1.61614 [07/23/2021-23:47:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.96 [07/23/2021-23:47:24] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:24] [V] [TRT] Tactic: 1002 time 0.985728 [07/23/2021-23:47:24] [V] [TRT] Tactic: 0 time 4.43763 [07/23/2021-23:47:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.985728 [07/23/2021-23:47:24] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:24] [V] [TRT] Tactic: 1002 time 1.02797 [07/23/2021-23:47:24] [V] [TRT] Tactic: 0 time 0.901396 [07/23/2021-23:47:24] [V] [TRT] Fastest Tactic: 0 Time: 0.901396 [07/23/2021-23:47:24] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:24] [V] [TRT] Tactic: 1002 time 2.12787 [07/23/2021-23:47:24] [V] [TRT] Tactic: 0 time 0.89856 [07/23/2021-23:47:24] [V] [TRT] Fastest Tactic: 0 Time: 0.89856 [07/23/2021-23:47:24] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:24] [V] [TRT] Tactic: 1002 time 0.770304 [07/23/2021-23:47:25] [V] [TRT] Tactic: 0 time 4 [07/23/2021-23:47:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.770304 [07/23/2021-23:47:25] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:25] [V] [TRT] Tactic: 1002 time 1.26592 [07/23/2021-23:47:25] [V] [TRT] Tactic: 0 time 4.47578 [07/23/2021-23:47:25] [V] [TRT] Fastest Tactic: 1002 Time: 1.26592 [07/23/2021-23:47:25] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:25] [V] [TRT] Tactic: 1002 time 2.1225 [07/23/2021-23:47:25] [V] [TRT] Tactic: 0 time 0.64832 [07/23/2021-23:47:25] [V] [TRT] Fastest Tactic: 0 Time: 0.64832 [07/23/2021-23:47:25] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:25] [V] [TRT] Tactic: 1002 time 1.03718 [07/23/2021-23:47:25] [V] [TRT] Tactic: 0 time 4.44032 [07/23/2021-23:47:25] [V] [TRT] Fastest Tactic: 1002 Time: 1.03718 [07/23/2021-23:47:25] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:25] [V] [TRT] Tactic: 1002 time 2.12762 [07/23/2021-23:47:25] [V] [TRT] Tactic: 0 time 0.899328 [07/23/2021-23:47:25] [V] [TRT] Fastest Tactic: 0 Time: 0.899328 [07/23/2021-23:47:25] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:25] [V] [TRT] Tactic: 1002 time 2.12826 [07/23/2021-23:47:25] [V] [TRT] Tactic: 0 time 0.897672 [07/23/2021-23:47:25] [V] [TRT] Fastest Tactic: 0 Time: 0.897672 [07/23/2021-23:47:25] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:25] [V] [TRT] Tactic: 1002 time 0.93952 [07/23/2021-23:47:25] [V] [TRT] Tactic: 0 time 3.99862 [07/23/2021-23:47:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.93952 [07/23/2021-23:47:25] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:26] [V] [TRT] Tactic: 1002 time 1.26644 [07/23/2021-23:47:26] [V] [TRT] Tactic: 0 time 4.4745 [07/23/2021-23:47:26] [V] [TRT] Fastest Tactic: 1002 Time: 1.26644 [07/23/2021-23:47:26] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:26] [V] [TRT] Tactic: 1002 time 2.1225 [07/23/2021-23:47:26] [V] [TRT] Tactic: 0 time 0.664576 [07/23/2021-23:47:26] [V] [TRT] Fastest Tactic: 0 Time: 0.664576 [07/23/2021-23:47:26] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:26] [V] [TRT] Tactic: 1002 time 0.910976 [07/23/2021-23:47:26] [V] [TRT] Tactic: 0 time 0.672896 [07/23/2021-23:47:26] [V] [TRT] Fastest Tactic: 0 Time: 0.672896 [07/23/2021-23:47:26] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:26] [V] [TRT] Tactic: 1002 time 0.83648 [07/23/2021-23:47:26] [V] [TRT] Tactic: 0 time 1.02554 [07/23/2021-23:47:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.83648 [07/23/2021-23:47:26] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:26] [V] [TRT] Tactic: 1002 time 0.97536 [07/23/2021-23:47:26] [V] [TRT] Tactic: 0 time 1.0464 [07/23/2021-23:47:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.97536 [07/23/2021-23:47:26] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:26] [V] [TRT] Tactic: 1002 time 0.713492 [07/23/2021-23:47:26] [V] [TRT] Tactic: 0 time 0.476928 [07/23/2021-23:47:26] [V] [TRT] Fastest Tactic: 0 Time: 0.476928 [07/23/2021-23:47:26] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:26] [V] [TRT] Tactic: 1002 time 1.17146 [07/23/2021-23:47:26] [V] [TRT] Tactic: 0 time 0.512768 [07/23/2021-23:47:26] [V] [TRT] Fastest Tactic: 0 Time: 0.512768 [07/23/2021-23:47:26] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:26] [V] [TRT] Tactic: 1002 time 0.939136 [07/23/2021-23:47:26] [V] [TRT] Tactic: 0 time 0.954496 [07/23/2021-23:47:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.939136 [07/23/2021-23:47:26] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:27] [V] [TRT] Tactic: 1002 time 1.43104 [07/23/2021-23:47:27] [V] [TRT] Tactic: 0 time 0.667008 [07/23/2021-23:47:27] [V] [TRT] Fastest Tactic: 0 Time: 0.667008 [07/23/2021-23:47:27] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:27] [V] [TRT] Tactic: 1002 time 0.94006 [07/23/2021-23:47:27] [V] [TRT] Tactic: 0 time 0.785664 [07/23/2021-23:47:27] [V] [TRT] Fastest Tactic: 0 Time: 0.785664 [07/23/2021-23:47:27] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:27] [V] [TRT] Tactic: 1002 time 0.940416 [07/23/2021-23:47:27] [V] [TRT] Tactic: 0 time 0.801796 [07/23/2021-23:47:27] [V] [TRT] Fastest Tactic: 0 Time: 0.801796 [07/23/2021-23:47:27] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:27] [V] [TRT] Tactic: 1002 time 1.40979 [07/23/2021-23:47:27] [V] [TRT] Tactic: 0 time 0.494592 [07/23/2021-23:47:27] [V] [TRT] Fastest Tactic: 0 Time: 0.494592 [07/23/2021-23:47:27] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:27] [V] [TRT] Tactic: 1002 time 1.152 [07/23/2021-23:47:27] [V] [TRT] Tactic: 0 time 0.457088 [07/23/2021-23:47:27] [V] [TRT] Fastest Tactic: 0 Time: 0.457088 [07/23/2021-23:47:27] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:27] [V] [TRT] Tactic: 1002 time 0.92352 [07/23/2021-23:47:27] [V] [TRT] Tactic: 0 time 0.675456 [07/23/2021-23:47:27] [V] [TRT] Fastest Tactic: 0 Time: 0.675456 [07/23/2021-23:47:27] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:27] [V] [TRT] Tactic: 1002 time 0.959232 [07/23/2021-23:47:27] [V] [TRT] Tactic: 0 time 4.30195 [07/23/2021-23:47:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.959232 [07/23/2021-23:47:27] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:27] [V] [TRT] Tactic: 1002 time 2.1655 [07/23/2021-23:47:27] [V] [TRT] Tactic: 0 time 0.6784 [07/23/2021-23:47:27] [V] [TRT] Fastest Tactic: 0 Time: 0.6784 [07/23/2021-23:47:27] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:28] [V] [TRT] Tactic: 1002 time 2.16576 [07/23/2021-23:47:28] [V] [TRT] Tactic: 0 time 0.6944 [07/23/2021-23:47:28] [V] [TRT] Fastest Tactic: 0 Time: 0.6944 [07/23/2021-23:47:28] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:28] [V] [TRT] Tactic: 1002 time 0.933632 [07/23/2021-23:47:28] [V] [TRT] Tactic: 0 time 3.91693 [07/23/2021-23:47:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.933632 [07/23/2021-23:47:28] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:28] [V] [TRT] Tactic: 1002 time 1.19782 [07/23/2021-23:47:28] [V] [TRT] Tactic: 0 time 4.3831 [07/23/2021-23:47:28] [V] [TRT] Fastest Tactic: 1002 Time: 1.19782 [07/23/2021-23:47:28] [V] [TRT] --------------- Timing Runner: Slice__219 (Reformat) [07/23/2021-23:47:28] [V] [TRT] Tactic: 1002 time 2.15667 [07/23/2021-23:47:28] [V] [TRT] Tactic: 0 time 0.452608 [07/23/2021-23:47:28] [V] [TRT] Fastest Tactic: 0 Time: 0.452608 [07/23/2021-23:47:30] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,8388608) -> Float(1,256,65536,8388608) *************** [07/23/2021-23:47:30] [V] [TRT] --------------- Timing Runner: const_fold_opt__476 + StatefulPartitionedCall/model/conv2d_transpose_2/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_2/Relu (Scale) [07/23/2021-23:47:30] [V] [TRT] Tactic: 0 time 0.90688 [07/23/2021-23:47:30] [V] [TRT] Fastest Tactic: 0 Time: 0.90688 [07/23/2021-23:47:30] [V] [TRT] *************** Autotuning format combination: Float(128,32768,1,8388608) -> Float(128,32768,1,8388608) *************** [07/23/2021-23:47:30] [V] [TRT] --------------- Timing Runner: const_fold_opt__476 + StatefulPartitionedCall/model/conv2d_transpose_2/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_2/Relu (Scale) [07/23/2021-23:47:30] [V] [TRT] Scale has no valid tactics for this config, skipping [07/23/2021-23:47:31] [V] [TRT] *************** Autotuning format combination: Float(32,8192,1:4,2097152) -> Float(32,8192,1:4,2097152) *************** [07/23/2021-23:47:31] [V] [TRT] --------------- Timing Runner: const_fold_opt__476 + StatefulPartitionedCall/model/conv2d_transpose_2/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_2/Relu (Scale) [07/23/2021-23:47:31] [V] [TRT] Scale has no valid tactics for this config, skipping [07/23/2021-23:47:31] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,8388608) -> Half(1,256,65536,8388608) *************** [07/23/2021-23:47:31] [V] [TRT] --------------- Timing Runner: const_fold_opt__476 + StatefulPartitionedCall/model/conv2d_transpose_2/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_2/Relu (Scale) [07/23/2021-23:47:31] [V] [TRT] Tactic: 0 time 0.451968 [07/23/2021-23:47:31] [V] [TRT] Fastest Tactic: 0 Time: 0.451968 [07/23/2021-23:47:31] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,4194304) -> Half(1,256,65536:2,4194304) *************** [07/23/2021-23:47:31] [V] [TRT] --------------- Timing Runner: const_fold_opt__476 + StatefulPartitionedCall/model/conv2d_transpose_2/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_2/Relu (Scale) [07/23/2021-23:47:31] [V] [TRT] Tactic: 0 time 0.451968 [07/23/2021-23:47:31] [V] [TRT] Fastest Tactic: 0 Time: 0.451968 [07/23/2021-23:47:31] [V] [TRT] *************** Autotuning format combination: Half(16,4096,1:8,1048576) -> Half(16,4096,1:8,1048576) *************** [07/23/2021-23:47:31] [V] [TRT] --------------- Timing Runner: const_fold_opt__476 + StatefulPartitionedCall/model/conv2d_transpose_2/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_2/Relu (Scale) [07/23/2021-23:47:31] [V] [TRT] Tactic: 0 time 0.45248 [07/23/2021-23:47:31] [V] [TRT] Fastest Tactic: 0 Time: 0.45248 [07/23/2021-23:47:33] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,8388608) -> Float(1,258,66564,17040384) *************** [07/23/2021-23:47:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:34] [V] [TRT] Tactic: 0 time 25.1237 [07/23/2021-23:47:34] [V] [TRT] Tactic: 1 time 7.90797 [07/23/2021-23:47:34] [V] [TRT] Tactic: 3 time 26.7598 [07/23/2021-23:47:34] [V] [TRT] Tactic: 4 time 11.8125 [07/23/2021-23:47:35] [V] [TRT] Tactic: 5 time 17.7432 [07/23/2021-23:47:35] [V] [TRT] Fastest Tactic: 1 Time: 7.90797 [07/23/2021-23:47:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:35] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:35] [V] [TRT] Tactic: 0 time 42.1334 [07/23/2021-23:47:35] [V] [TRT] Fastest Tactic: 0 Time: 42.1334 [07/23/2021-23:47:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 1 [07/23/2021-23:47:35] [V] [TRT] [07/23/2021-23:47:35] [V] [TRT] *************** Autotuning format combination: Float(128,32768,1,8388608) -> Float(256,66048,1,17040384) *************** [07/23/2021-23:47:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:35] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:35] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:35] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:36] [V] [TRT] *************** Autotuning format combination: Float(32,8192,1:4,2097152) -> Float(64,16512,1:4,4260096) *************** [07/23/2021-23:47:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:36] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:36] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:36] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:36] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,8388608) -> Half(1,258,66564,17040384) *************** [07/23/2021-23:47:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:36] [V] [TRT] Tactic: 0 time 41.7188 [07/23/2021-23:47:37] [V] [TRT] Tactic: 1 time 14.928 [07/23/2021-23:47:37] [V] [TRT] Tactic: 3 time 25.7998 [07/23/2021-23:47:37] [V] [TRT] Tactic: 4 time 13.7569 [07/23/2021-23:47:38] [V] [TRT] Tactic: 5 time 16.7549 [07/23/2021-23:47:38] [V] [TRT] Fastest Tactic: 4 Time: 13.7569 [07/23/2021-23:47:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:38] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:38] [V] [TRT] Tactic: 0 time 12.4942 [07/23/2021-23:47:38] [V] [TRT] Fastest Tactic: 0 Time: 12.4942 [07/23/2021-23:47:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: GemmDeconvolution Tactic: 0 [07/23/2021-23:47:38] [V] [TRT] [07/23/2021-23:47:38] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,4194304) -> Half(1,258,66564:2,8520192) *************** [07/23/2021-23:47:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:38] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:38] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:38] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:38] [V] [TRT] *************** Autotuning format combination: Half(16,4096,1:8,1048576) -> Half(32,8256,1:8,2130048) *************** [07/23/2021-23:47:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose (CudnnDeconvolution) [07/23/2021-23:47:38] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose (CaskDeconvolution) [07/23/2021-23:47:38] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping [07/23/2021-23:47:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose (GemmDeconvolution) [07/23/2021-23:47:38] [V] [TRT] Tactic: 0 time 5.97466 [07/23/2021-23:47:38] [V] [TRT] Fastest Tactic: 0 Time: 5.97466 [07/23/2021-23:47:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: GemmDeconvolution Tactic: 0 [07/23/2021-23:47:38] [V] [TRT] [07/23/2021-23:47:38] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:38] [V] [TRT] Tactic: 1002 time 2.21094 [07/23/2021-23:47:38] [V] [TRT] Tactic: 0 time 1.80557 [07/23/2021-23:47:38] [V] [TRT] Fastest Tactic: 0 Time: 1.80557 [07/23/2021-23:47:38] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:38] [V] [TRT] Tactic: 1002 time 2.21427 [07/23/2021-23:47:38] [V] [TRT] Tactic: 0 time 3.86998 [07/23/2021-23:47:38] [V] [TRT] Fastest Tactic: 1002 Time: 2.21427 [07/23/2021-23:47:38] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:38] [V] [TRT] Tactic: 1002 time 2.32589 [07/23/2021-23:47:39] [V] [TRT] Tactic: 0 time 4.02253 [07/23/2021-23:47:39] [V] [TRT] Fastest Tactic: 1002 Time: 2.32589 [07/23/2021-23:47:39] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:39] [V] [TRT] Tactic: 1002 time 1.72698 [07/23/2021-23:47:39] [V] [TRT] Tactic: 0 time 1.28678 [07/23/2021-23:47:39] [V] [TRT] Fastest Tactic: 0 Time: 1.28678 [07/23/2021-23:47:39] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:39] [V] [TRT] Tactic: 1002 time 2.37312 [07/23/2021-23:47:39] [V] [TRT] Tactic: 0 time 1.32147 [07/23/2021-23:47:39] [V] [TRT] Fastest Tactic: 0 Time: 1.32147 [07/23/2021-23:47:39] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:39] [V] [TRT] Tactic: 1002 time 1.93871 [07/23/2021-23:47:39] [V] [TRT] Tactic: 0 time 4.0969 [07/23/2021-23:47:39] [V] [TRT] Fastest Tactic: 1002 Time: 1.93871 [07/23/2021-23:47:39] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:39] [V] [TRT] Tactic: 1002 time 1.99603 [07/23/2021-23:47:39] [V] [TRT] Tactic: 0 time 12.7702 [07/23/2021-23:47:39] [V] [TRT] Fastest Tactic: 1002 Time: 1.99603 [07/23/2021-23:47:39] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:39] [V] [TRT] Tactic: 1002 time 2.05619 [07/23/2021-23:47:40] [V] [TRT] Tactic: 0 time 1.78688 [07/23/2021-23:47:40] [V] [TRT] Fastest Tactic: 0 Time: 1.78688 [07/23/2021-23:47:40] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:40] [V] [TRT] Tactic: 1002 time 2.87154 [07/23/2021-23:47:40] [V] [TRT] Tactic: 0 time 1.78291 [07/23/2021-23:47:40] [V] [TRT] Fastest Tactic: 0 Time: 1.78291 [07/23/2021-23:47:40] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:40] [V] [TRT] Tactic: 1002 time 1.56838 [07/23/2021-23:47:40] [V] [TRT] Tactic: 0 time 11.5274 [07/23/2021-23:47:40] [V] [TRT] Fastest Tactic: 1002 Time: 1.56838 [07/23/2021-23:47:40] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:40] [V] [TRT] Tactic: 1002 time 2.70515 [07/23/2021-23:47:40] [V] [TRT] Tactic: 0 time 12.8365 [07/23/2021-23:47:40] [V] [TRT] Fastest Tactic: 1002 Time: 2.70515 [07/23/2021-23:47:40] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:40] [V] [TRT] Tactic: 1002 time 2.80984 [07/23/2021-23:47:41] [V] [TRT] Tactic: 0 time 1.29523 [07/23/2021-23:47:41] [V] [TRT] Fastest Tactic: 0 Time: 1.29523 [07/23/2021-23:47:41] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:41] [V] [TRT] Tactic: 1002 time 2.09754 [07/23/2021-23:47:41] [V] [TRT] Tactic: 0 time 12.8058 [07/23/2021-23:47:41] [V] [TRT] Fastest Tactic: 1002 Time: 2.09754 [07/23/2021-23:47:41] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:41] [V] [TRT] Tactic: 1002 time 2.87168 [07/23/2021-23:47:41] [V] [TRT] Tactic: 0 time 1.78458 [07/23/2021-23:47:41] [V] [TRT] Fastest Tactic: 0 Time: 1.78458 [07/23/2021-23:47:41] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:41] [V] [TRT] Tactic: 1002 time 2.8649 [07/23/2021-23:47:41] [V] [TRT] Tactic: 0 time 1.78419 [07/23/2021-23:47:41] [V] [TRT] Fastest Tactic: 0 Time: 1.78419 [07/23/2021-23:47:41] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:41] [V] [TRT] Tactic: 1002 time 1.89811 [07/23/2021-23:47:41] [V] [TRT] Tactic: 0 time 11.5748 [07/23/2021-23:47:41] [V] [TRT] Fastest Tactic: 1002 Time: 1.89811 [07/23/2021-23:47:42] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:42] [V] [TRT] Tactic: 1002 time 2.68941 [07/23/2021-23:47:42] [V] [TRT] Tactic: 0 time 12.8524 [07/23/2021-23:47:42] [V] [TRT] Fastest Tactic: 1002 Time: 2.68941 [07/23/2021-23:47:42] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:42] [V] [TRT] Tactic: 1002 time 2.81267 [07/23/2021-23:47:42] [V] [TRT] Tactic: 0 time 1.33018 [07/23/2021-23:47:42] [V] [TRT] Fastest Tactic: 0 Time: 1.33018 [07/23/2021-23:47:42] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:42] [V] [TRT] Tactic: 1002 time 1.84166 [07/23/2021-23:47:42] [V] [TRT] Tactic: 0 time 1.34016 [07/23/2021-23:47:42] [V] [TRT] Fastest Tactic: 0 Time: 1.34016 [07/23/2021-23:47:42] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:42] [V] [TRT] Tactic: 1002 time 1.73069 [07/23/2021-23:47:42] [V] [TRT] Tactic: 0 time 2.22554 [07/23/2021-23:47:42] [V] [TRT] Fastest Tactic: 1002 Time: 1.73069 [07/23/2021-23:47:42] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:42] [V] [TRT] Tactic: 1002 time 1.99347 [07/23/2021-23:47:42] [V] [TRT] Tactic: 0 time 2.31578 [07/23/2021-23:47:42] [V] [TRT] Fastest Tactic: 1002 Time: 1.99347 [07/23/2021-23:47:42] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:43] [V] [TRT] Tactic: 1002 time 1.44102 [07/23/2021-23:47:43] [V] [TRT] Tactic: 0 time 0.950528 [07/23/2021-23:47:43] [V] [TRT] Fastest Tactic: 0 Time: 0.950528 [07/23/2021-23:47:43] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:43] [V] [TRT] Tactic: 1002 time 2.36314 [07/23/2021-23:47:43] [V] [TRT] Tactic: 0 time 1.0912 [07/23/2021-23:47:43] [V] [TRT] Fastest Tactic: 0 Time: 1.0912 [07/23/2021-23:47:43] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:43] [V] [TRT] Tactic: 1002 time 1.88966 [07/23/2021-23:47:43] [V] [TRT] Tactic: 0 time 2.30016 [07/23/2021-23:47:43] [V] [TRT] Fastest Tactic: 1002 Time: 1.88966 [07/23/2021-23:47:43] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:43] [V] [TRT] Tactic: 1002 time 2.89958 [07/23/2021-23:47:43] [V] [TRT] Tactic: 0 time 1.3335 [07/23/2021-23:47:43] [V] [TRT] Fastest Tactic: 0 Time: 1.3335 [07/23/2021-23:47:43] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:43] [V] [TRT] Tactic: 1002 time 1.90182 [07/23/2021-23:47:43] [V] [TRT] Tactic: 0 time 1.96134 [07/23/2021-23:47:43] [V] [TRT] Fastest Tactic: 1002 Time: 1.90182 [07/23/2021-23:47:43] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:43] [V] [TRT] Tactic: 1002 time 1.90067 [07/23/2021-23:47:43] [V] [TRT] Tactic: 0 time 2.02701 [07/23/2021-23:47:43] [V] [TRT] Fastest Tactic: 1002 Time: 1.90067 [07/23/2021-23:47:43] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:43] [V] [TRT] Tactic: 1002 time 2.84134 [07/23/2021-23:47:44] [V] [TRT] Tactic: 0 time 1.02118 [07/23/2021-23:47:44] [V] [TRT] Fastest Tactic: 0 Time: 1.02118 [07/23/2021-23:47:44] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:44] [V] [TRT] Tactic: 1002 time 2.31514 [07/23/2021-23:47:44] [V] [TRT] Tactic: 0 time 0.905856 [07/23/2021-23:47:44] [V] [TRT] Fastest Tactic: 0 Time: 0.905856 [07/23/2021-23:47:44] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:44] [V] [TRT] Tactic: 1002 time 1.84883 [07/23/2021-23:47:44] [V] [TRT] Tactic: 0 time 1.95226 [07/23/2021-23:47:44] [V] [TRT] Fastest Tactic: 1002 Time: 1.84883 [07/23/2021-23:47:44] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:44] [V] [TRT] Tactic: 1002 time 1.92602 [07/23/2021-23:47:44] [V] [TRT] Tactic: 0 time 8.67635 [07/23/2021-23:47:44] [V] [TRT] Fastest Tactic: 1002 Time: 1.92602 [07/23/2021-23:47:44] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:44] [V] [TRT] Tactic: 1002 time 2.95885 [07/23/2021-23:47:44] [V] [TRT] Tactic: 0 time 1.34874 [07/23/2021-23:47:44] [V] [TRT] Fastest Tactic: 0 Time: 1.34874 [07/23/2021-23:47:44] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:44] [V] [TRT] Tactic: 1002 time 2.95168 [07/23/2021-23:47:44] [V] [TRT] Tactic: 0 time 1.37779 [07/23/2021-23:47:44] [V] [TRT] Fastest Tactic: 0 Time: 1.37779 [07/23/2021-23:47:44] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:45] [V] [TRT] Tactic: 1002 time 1.87789 [07/23/2021-23:47:45] [V] [TRT] Tactic: 0 time 7.81811 [07/23/2021-23:47:45] [V] [TRT] Fastest Tactic: 1002 Time: 1.87789 [07/23/2021-23:47:45] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:45] [V] [TRT] Tactic: 1002 time 2.40832 [07/23/2021-23:47:45] [V] [TRT] Tactic: 0 time 8.7305 [07/23/2021-23:47:45] [V] [TRT] Fastest Tactic: 1002 Time: 2.40832 [07/23/2021-23:47:45] [V] [TRT] --------------- Timing Runner: Slice__281 (Reformat) [07/23/2021-23:47:45] [V] [TRT] Tactic: 1002 time 2.90496 [07/23/2021-23:47:45] [V] [TRT] Tactic: 0 time 0.897792 [07/23/2021-23:47:45] [V] [TRT] Fastest Tactic: 0 Time: 0.897792 [07/23/2021-23:47:47] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,16777216) -> Float(1,256,65536,16777216) *************** [07/23/2021-23:47:47] [V] [TRT] --------------- Timing Runner: const_fold_opt__480 + StatefulPartitionedCall/model/conv2d_transpose_3/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_3/Relu (Scale) [07/23/2021-23:47:48] [V] [TRT] Tactic: 0 time 1.79701 [07/23/2021-23:47:48] [V] [TRT] Fastest Tactic: 0 Time: 1.79701 [07/23/2021-23:47:48] [V] [TRT] *************** Autotuning format combination: Float(256,65536,1,16777216) -> Float(256,65536,1,16777216) *************** [07/23/2021-23:47:48] [V] [TRT] --------------- Timing Runner: const_fold_opt__480 + StatefulPartitionedCall/model/conv2d_transpose_3/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_3/Relu (Scale) [07/23/2021-23:47:48] [V] [TRT] Scale has no valid tactics for this config, skipping [07/23/2021-23:47:48] [V] [TRT] *************** Autotuning format combination: Float(64,16384,1:4,4194304) -> Float(64,16384,1:4,4194304) *************** [07/23/2021-23:47:48] [V] [TRT] --------------- Timing Runner: const_fold_opt__480 + StatefulPartitionedCall/model/conv2d_transpose_3/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_3/Relu (Scale) [07/23/2021-23:47:48] [V] [TRT] Scale has no valid tactics for this config, skipping [07/23/2021-23:47:48] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,16777216) -> Half(1,256,65536,16777216) *************** [07/23/2021-23:47:48] [V] [TRT] --------------- Timing Runner: const_fold_opt__480 + StatefulPartitionedCall/model/conv2d_transpose_3/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_3/Relu (Scale) [07/23/2021-23:47:48] [V] [TRT] Tactic: 0 time 0.89856 [07/23/2021-23:47:48] [V] [TRT] Fastest Tactic: 0 Time: 0.89856 [07/23/2021-23:47:48] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,8388608) -> Half(1,256,65536:2,8388608) *************** [07/23/2021-23:47:48] [V] [TRT] --------------- Timing Runner: const_fold_opt__480 + StatefulPartitionedCall/model/conv2d_transpose_3/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_3/Relu (Scale) [07/23/2021-23:47:48] [V] [TRT] Tactic: 0 time 0.899968 [07/23/2021-23:47:48] [V] [TRT] Fastest Tactic: 0 Time: 0.899968 [07/23/2021-23:47:48] [V] [TRT] *************** Autotuning format combination: Half(32,8192,1:8,2097152) -> Half(32,8192,1:8,2097152) *************** [07/23/2021-23:47:48] [V] [TRT] --------------- Timing Runner: const_fold_opt__480 + StatefulPartitionedCall/model/conv2d_transpose_3/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_3/Relu (Scale) [07/23/2021-23:47:48] [V] [TRT] Tactic: 0 time 0.897024 [07/23/2021-23:47:48] [V] [TRT] Fastest Tactic: 0 Time: 0.897024 [07/23/2021-23:47:50] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,16777216) -> Float(1,256,65536,16777216) *************** [07/23/2021-23:47:50] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 [07/23/2021-23:47:50] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 [07/23/2021-23:47:50] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 [07/23/2021-23:47:50] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 [07/23/2021-23:47:50] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 [07/23/2021-23:47:50] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 [07/23/2021-23:47:50] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 [07/23/2021-23:47:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (FusedConvActConvolution) [07/23/2021-23:47:50] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:47:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CaskConvolution) [07/23/2021-23:47:50] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 [07/23/2021-23:47:51] [V] [TRT] Tactic: 4549827808004681195 time 33.5478 [07/23/2021-23:47:51] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 [07/23/2021-23:47:51] [V] [TRT] Tactic: 5779835512569528575 time 30.0508 [07/23/2021-23:47:51] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 [07/23/2021-23:47:52] [V] [TRT] Tactic: 6053873026024413720 time 30.6797 [07/23/2021-23:47:52] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 [07/23/2021-23:47:53] [V] [TRT] Tactic: 6767548733843469815 time 32.5773 [07/23/2021-23:47:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 [07/23/2021-23:47:53] [V] [TRT] Tactic: -6313876406580483184 time 36.6944 [07/23/2021-23:47:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 [07/23/2021-23:47:54] [V] [TRT] Tactic: -1123676555321336786 time 30.3512 [07/23/2021-23:47:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 [07/23/2021-23:47:54] [V] [TRT] Tactic: -701551393537224327 time 33.967 [07/23/2021-23:47:54] [V] [TRT] Fastest Tactic: 5779835512569528575 Time: 30.0508 [07/23/2021-23:47:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CudaConvolution) [07/23/2021-23:47:55] [V] [TRT] Tactic: 0 time 45.5286 [07/23/2021-23:47:55] [V] [TRT] Tactic: 1 time 14.8783 [07/23/2021-23:47:56] [V] [TRT] Tactic: 2 time 50.7277 [07/23/2021-23:47:57] [V] [TRT] Tactic: 5 time 50.3458 [07/23/2021-23:47:57] [V] [TRT] Tactic: 6 time 22.1608 [07/23/2021-23:47:58] [V] [TRT] Tactic: 56 time 45.4166 [07/23/2021-23:47:58] [V] [TRT] Tactic: 57 time 14.8533 [07/23/2021-23:47:59] [V] [TRT] Tactic: 58 time 50.8361 [07/23/2021-23:48:00] [V] [TRT] Tactic: 61 time 50.4055 [07/23/2021-23:48:00] [V] [TRT] Tactic: 62 time 22.2641 [07/23/2021-23:48:01] [V] [TRT] Tactic: 112 time 45.4751 [07/23/2021-23:48:02] [V] [TRT] Tactic: 113 time 40.0476 [07/23/2021-23:48:02] [V] [TRT] Tactic: 114 time 50.6938 [07/23/2021-23:48:03] [V] [TRT] Tactic: 117 time 50.3483 [07/23/2021-23:48:04] [V] [TRT] Tactic: 118 time 22.1471 [07/23/2021-23:48:04] [V] [TRT] Fastest Tactic: 57 Time: 14.8533 [07/23/2021-23:48:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CudaDepthwiseConvolution) [07/23/2021-23:48:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CublasConvolution) [07/23/2021-23:48:04] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 57 [07/23/2021-23:48:04] [V] [TRT] [07/23/2021-23:48:04] [V] [TRT] *************** Autotuning format combination: Float(256,65536,1,16777216) -> Float(256,65536,1,16777216) *************** [07/23/2021-23:48:04] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:04] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:04] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:04] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:04] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:04] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:04] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:04] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:04] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:04] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:04] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (FusedConvActConvolution) [07/23/2021-23:48:04] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CaskConvolution) [07/23/2021-23:48:04] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:04] [V] [TRT] Tactic: 2860655430572478466 time 32.4724 [07/23/2021-23:48:04] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:05] [V] [TRT] Tactic: 4474630279712975759 time 35.5319 [07/23/2021-23:48:05] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:05] [V] [TRT] Tactic: 4479823862704990365 time 35.2398 [07/23/2021-23:48:05] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:06] [V] [TRT] Tactic: 4696204239951173149 time 32.6624 [07/23/2021-23:48:06] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:07] [V] [TRT] Tactic: 5778138195697110003 time 30.8705 [07/23/2021-23:48:07] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:07] [V] [TRT] Tactic: 7155825427510256858 time 30.2175 [07/23/2021-23:48:07] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:08] [V] [TRT] Tactic: 8918020581761223752 time 30.0092 [07/23/2021-23:48:08] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:08] [V] [TRT] Tactic: -4756382386362004279 time 32.5288 [07/23/2021-23:48:08] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:09] [V] [TRT] Tactic: -3855385237722507464 time 31.2061 [07/23/2021-23:48:09] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:09] [V] [TRT] Tactic: -2809379259463049391 time 31.1572 [07/23/2021-23:48:09] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] Tactic: -504296718212024303 time 30.1823 [07/23/2021-23:48:10] [V] [TRT] Fastest Tactic: 8918020581761223752 Time: 30.0092 [07/23/2021-23:48:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CudaConvolution) [07/23/2021-23:48:10] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CudaDepthwiseConvolution) [07/23/2021-23:48:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CublasConvolution) [07/23/2021-23:48:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8918020581761223752 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] *************** Autotuning format combination: Float(64,16384,1:4,4194304) -> Float(64,16384,1:4,4194304) *************** [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_indexed_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (FusedConvActConvolution) [07/23/2021-23:48:10] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CaskConvolution) [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:10] [V] [TRT] Tactic: 2860655430572478466 time 32.2189 [07/23/2021-23:48:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:11] [V] [TRT] Tactic: 4474630279712975759 time 35.5057 [07/23/2021-23:48:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:11] [V] [TRT] Tactic: 4479823862704990365 time 35.1812 [07/23/2021-23:48:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:12] [V] [TRT] Tactic: 4696204239951173149 time 32.7477 [07/23/2021-23:48:12] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:12] [V] [TRT] Tactic: 5778138195697110003 time 30.8694 [07/23/2021-23:48:12] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_indexed_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:48:13] [V] [TRT] Tactic: 6642501658177097719 time 11.5005 [07/23/2021-23:48:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:48:13] [V] [TRT] Tactic: 6670616668161295401 time 11.3629 [07/23/2021-23:48:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:13] [V] [TRT] Tactic: 7155825427510256858 time 30.1069 [07/23/2021-23:48:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:14] [V] [TRT] Tactic: 8918020581761223752 time 30.0593 [07/23/2021-23:48:14] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:48:14] [V] [TRT] Tactic: -8844488725130067278 time 10.5469 [07/23/2021-23:48:14] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:15] [V] [TRT] Tactic: -4756382386362004279 time 32.3698 [07/23/2021-23:48:15] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:15] [V] [TRT] Tactic: -3855385237722507464 time 30.8924 [07/23/2021-23:48:15] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:16] [V] [TRT] Tactic: -2809379259463049391 time 31.2635 [07/23/2021-23:48:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:16] [V] [TRT] Tactic: -504296718212024303 time 30.016 [07/23/2021-23:48:16] [V] [TRT] Fastest Tactic: -8844488725130067278 Time: 10.5469 [07/23/2021-23:48:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CudaConvolution) [07/23/2021-23:48:16] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CudaDepthwiseConvolution) [07/23/2021-23:48:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CublasConvolution) [07/23/2021-23:48:16] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8844488725130067278 [07/23/2021-23:48:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:48:16] [V] [TRT] [07/23/2021-23:48:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_indexed_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:48:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:48:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:48:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f32f32f32_nhwc_nhwc_fprop_1x3x3_128x128x16x1_16x8x8_4stages_tf32 [07/23/2021-23:48:16] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,16777216) -> Half(1,256,65536,16777216) *************** [07/23/2021-23:48:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (FusedConvActConvolution) [07/23/2021-23:48:16] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CaskConvolution) [07/23/2021-23:48:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CudaConvolution) [07/23/2021-23:48:17] [V] [TRT] Tactic: 0 time 44.4977 [07/23/2021-23:48:18] [V] [TRT] Tactic: 1 time 38.7352 [07/23/2021-23:48:18] [V] [TRT] Tactic: 2 time 45.8559 [07/23/2021-23:48:19] [V] [TRT] Tactic: 5 time 47.4646 [07/23/2021-23:48:19] [V] [TRT] Tactic: 6 time 23.1684 [07/23/2021-23:48:20] [V] [TRT] Tactic: 56 time 44.5116 [07/23/2021-23:48:21] [V] [TRT] Tactic: 58 time 46.0791 [07/23/2021-23:48:22] [V] [TRT] Tactic: 61 time 47.4739 [07/23/2021-23:48:22] [V] [TRT] Tactic: 62 time 23.0271 [07/23/2021-23:48:22] [V] [TRT] Fastest Tactic: 62 Time: 23.0271 [07/23/2021-23:48:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CudaDepthwiseConvolution) [07/23/2021-23:48:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CublasConvolution) [07/23/2021-23:48:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 62 [07/23/2021-23:48:22] [V] [TRT] [07/23/2021-23:48:22] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,8388608) -> Half(1,256,65536:2,8388608) *************** [07/23/2021-23:48:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:48:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:48:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:48:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:48:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:48:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:48:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:48:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:48:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:48:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:48:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (FusedConvActConvolution) [07/23/2021-23:48:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CaskConvolution) [07/23/2021-23:48:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:48:22] [V] [TRT] Tactic: 2195670545862694453 time 19.6169 [07/23/2021-23:48:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:48:23] [V] [TRT] Tactic: 3419182076704469245 time 18.663 [07/23/2021-23:48:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:48:23] [V] [TRT] Tactic: 3891805945559659536 time 18.0243 [07/23/2021-23:48:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:48:23] [V] [TRT] Tactic: 5548126322150286555 time 18.4672 [07/23/2021-23:48:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:48:24] [V] [TRT] Tactic: 6057304366605292508 time 18.4175 [07/23/2021-23:48:24] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:48:24] [V] [TRT] Tactic: -7928611605886347652 time 18.2918 [07/23/2021-23:48:24] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:48:24] [V] [TRT] Tactic: -5172391392092686714 time 19.8441 [07/23/2021-23:48:24] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:48:25] [V] [TRT] Tactic: -4374269919094467161 time 19.532 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:48:25] [V] [TRT] Tactic: -4083394051665370953 time 10.1006 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:48:25] [V] [TRT] Tactic: -1546027692247304867 time 17.9331 [07/23/2021-23:48:25] [V] [TRT] Fastest Tactic: -4083394051665370953 Time: 10.1006 [07/23/2021-23:48:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CudaConvolution) [07/23/2021-23:48:25] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CudaDepthwiseConvolution) [07/23/2021-23:48:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CublasConvolution) [07/23/2021-23:48:25] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4083394051665370953 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:48:25] [V] [TRT] [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:48:25] [V] [TRT] *************** Autotuning format combination: Half(32,8192,1:8,2097152) -> Float(1,256,65536,16777216) *************** [07/23/2021-23:48:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (FusedConvActConvolution) [07/23/2021-23:48:25] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CaskConvolution) [07/23/2021-23:48:25] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CudaConvolution) [07/23/2021-23:48:25] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CudaDepthwiseConvolution) [07/23/2021-23:48:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CublasConvolution) [07/23/2021-23:48:25] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:25] [V] [TRT] *************** Autotuning format combination: Half(32,8192,1:8,2097152) -> Half(32,8192,1:8,2097152) *************** [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:48:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (FusedConvActConvolution) [07/23/2021-23:48:25] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CaskConvolution) [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:25] [V] [TRT] Tactic: 254850674756030979 time 4.69722 [07/23/2021-23:48:25] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:26] [V] [TRT] Tactic: 1156328698016730421 time 4.95834 [07/23/2021-23:48:26] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:48:26] [V] [TRT] Tactic: 1584305878200231339 time 4.9376 [07/23/2021-23:48:26] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:48:26] [V] [TRT] Tactic: 1832046141070096030 time 5.35437 [07/23/2021-23:48:26] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:48:26] [V] [TRT] Tactic: 1838082074606840426 time 5.60243 [07/23/2021-23:48:26] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:48:26] [V] [TRT] Tactic: 1899296423087490472 time 6.44583 [07/23/2021-23:48:26] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:48:26] [V] [TRT] Tactic: 2338136297163812551 time 4.81242 [07/23/2021-23:48:26] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:26] [V] [TRT] Tactic: 2541579301352125276 time 5.14739 [07/23/2021-23:48:26] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:48:26] [V] [TRT] Tactic: 2657157263811141609 time 6.28685 [07/23/2021-23:48:26] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:48:26] [V] [TRT] Tactic: 2819719497590964443 time 6.02099 [07/23/2021-23:48:26] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:48:27] [V] [TRT] Tactic: 2835786846016979545 time 12.4493 [07/23/2021-23:48:27] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:48:27] [V] [TRT] Tactic: 2968605903460894194 time 5.24493 [07/23/2021-23:48:27] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:27] [V] [TRT] Tactic: 2986078304285316765 time 5.15571 [07/23/2021-23:48:27] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:48:27] [V] [TRT] Tactic: 3362537467505018070 time 4.71258 [07/23/2021-23:48:27] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:27] [V] [TRT] Tactic: 3513075359009385578 time 4.7387 [07/23/2021-23:48:27] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:48:27] [V] [TRT] Tactic: 3546424067684403057 time 12.2664 [07/23/2021-23:48:27] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:48:27] [V] [TRT] Tactic: 3573559043797674382 time 5.27066 [07/23/2021-23:48:27] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:27] [V] [TRT] Tactic: 3704534001553878387 time 5.09005 [07/23/2021-23:48:27] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:48:27] [V] [TRT] Tactic: 4278315135102886928 time 6.09549 [07/23/2021-23:48:27] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:48:28] [V] [TRT] Tactic: 4750655167565104065 time 5.8985 [07/23/2021-23:48:28] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:28] [V] [TRT] Tactic: 4802447371470387646 time 6.53773 [07/23/2021-23:48:28] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:28] [V] [TRT] Tactic: 5059676457552313631 time 4.71091 [07/23/2021-23:48:28] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:28] [V] [TRT] Tactic: 5398999388616959893 time 5.32224 [07/23/2021-23:48:28] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:48:28] [V] [TRT] Tactic: 5579149726397848560 time 5.3687 [07/23/2021-23:48:28] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:48:28] [V] [TRT] Tactic: 5746691132547383910 time 5.80941 [07/23/2021-23:48:28] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:28] [V] [TRT] Tactic: 5770170567977052602 time 6.57806 [07/23/2021-23:48:28] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:48:28] [V] [TRT] Tactic: 5896806418498994339 time 9.41045 [07/23/2021-23:48:28] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:48:28] [V] [TRT] Tactic: 6034364043891107501 time 5.72365 [07/23/2021-23:48:28] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:48:29] [V] [TRT] Tactic: 6074229447555668232 time 6.78374 [07/23/2021-23:48:29] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:48:29] [V] [TRT] Tactic: 6176524653920166422 time 6.56026 [07/23/2021-23:48:29] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:48:29] [V] [TRT] Tactic: 6272216432116166416 time 4.86323 [07/23/2021-23:48:29] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:48:29] [V] [TRT] Tactic: 6377497238381488891 time 4.81934 [07/23/2021-23:48:29] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:48:29] [V] [TRT] Tactic: 6428823438254963239 time 6.72757 [07/23/2021-23:48:29] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:48:29] [V] [TRT] Tactic: 6446388116965632819 time 5.6649 [07/23/2021-23:48:29] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:48:29] [V] [TRT] Tactic: 6468794451065529747 time 5.60602 [07/23/2021-23:48:29] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:29] [V] [TRT] Tactic: 6642277870194067185 time 5.03233 [07/23/2021-23:48:29] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:48:29] [V] [TRT] Tactic: 6725284471687256210 time 9.18477 [07/23/2021-23:48:29] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:48:29] [V] [TRT] Tactic: 6859477213531075460 time 6.3991 [07/23/2021-23:48:29] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:48:30] [V] [TRT] Tactic: 7100752989500049598 time 9.28947 [07/23/2021-23:48:30] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:30] [V] [TRT] Tactic: 7216571380637776659 time 5.08022 [07/23/2021-23:48:30] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:48:30] [V] [TRT] Tactic: 7609923741161019135 time 5.85203 [07/23/2021-23:48:30] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:48:30] [V] [TRT] Tactic: 7667554089956651578 time 6.53737 [07/23/2021-23:48:30] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:48:30] [V] [TRT] Tactic: 7705739241028240201 time 6.71578 [07/23/2021-23:48:30] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:48:30] [V] [TRT] Tactic: 8040838497444300918 time 8.39923 [07/23/2021-23:48:30] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:48:30] [V] [TRT] Tactic: 8101703987960976805 time 6.41229 [07/23/2021-23:48:30] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:48:30] [V] [TRT] Tactic: 8170606396342855895 time 5.61473 [07/23/2021-23:48:30] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:48:31] [V] [TRT] Tactic: 8264928564315835356 time 5.46202 [07/23/2021-23:48:31] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:31] [V] [TRT] Tactic: 8839784824303350101 time 5.0733 [07/23/2021-23:48:31] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:48:31] [V] [TRT] Tactic: -9217371357561775773 time 6.94976 [07/23/2021-23:48:31] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:31] [V] [TRT] Tactic: -9009272790678027912 time 6.78438 [07/23/2021-23:48:31] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:48:31] [V] [TRT] Tactic: -8949544755481315679 time 5.25376 [07/23/2021-23:48:31] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:48:31] [V] [TRT] Tactic: -8604374562669615024 time 6.7296 [07/23/2021-23:48:31] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:48:31] [V] [TRT] Tactic: -7938306756270351617 time 4.83315 [07/23/2021-23:48:31] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:48:31] [V] [TRT] Tactic: -7027328628217650515 time 4.77402 [07/23/2021-23:48:31] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:48:31] [V] [TRT] Tactic: -6840588038605932325 time 5.86522 [07/23/2021-23:48:31] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:48:31] [V] [TRT] Tactic: -6603588435230240365 time 4.92763 [07/23/2021-23:48:31] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:48:32] [V] [TRT] Tactic: -6356316196810535311 time 6.66419 [07/23/2021-23:48:32] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:32] [V] [TRT] Tactic: -6257787336162086472 time 5.1031 [07/23/2021-23:48:32] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:48:32] [V] [TRT] Tactic: -6063766379489217211 time 5.69461 [07/23/2021-23:48:32] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:48:32] [V] [TRT] Tactic: -6055152894973171263 time 5.71622 [07/23/2021-23:48:32] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:48:32] [V] [TRT] Tactic: -5634849406670564996 time 12.2161 [07/23/2021-23:48:32] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:32] [V] [TRT] Tactic: -5530886555766748586 time 4.96475 [07/23/2021-23:48:32] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:48:32] [V] [TRT] Tactic: -5421613452990385135 time 4.62579 [07/23/2021-23:48:32] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:48:32] [V] [TRT] Tactic: -5161596964442251102 time 5.74067 [07/23/2021-23:48:32] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:48:32] [V] [TRT] Tactic: -5127240325355316006 time 5.93459 [07/23/2021-23:48:32] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:48:33] [V] [TRT] Tactic: -4796511246675321840 time 6.03507 [07/23/2021-23:48:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:48:33] [V] [TRT] Tactic: -4706569565442112734 time 6.87373 [07/23/2021-23:48:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:48:33] [V] [TRT] Tactic: -4409144516525410768 time 5.06125 [07/23/2021-23:48:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:48:33] [V] [TRT] Tactic: -4379519430184503304 time 5.50438 [07/23/2021-23:48:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:48:33] [V] [TRT] Tactic: -4342782565153442362 time 4.7561 [07/23/2021-23:48:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:48:33] [V] [TRT] Tactic: -4191836638128696671 time 6.81613 [07/23/2021-23:48:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:33] [V] [TRT] Tactic: -4152066959007262150 time 4.78593 [07/23/2021-23:48:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:48:33] [V] [TRT] Tactic: -4021926646879732549 time 5.86099 [07/23/2021-23:48:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:48:33] [V] [TRT] Tactic: -3987638434926559037 time 6.01882 [07/23/2021-23:48:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:48:33] [V] [TRT] Tactic: -3939749857557624176 time 6.60992 [07/23/2021-23:48:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:34] [V] [TRT] Tactic: -3905653247016903130 time 5.3559 [07/23/2021-23:48:34] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:48:34] [V] [TRT] Tactic: -3895429239811098010 time 6.0855 [07/23/2021-23:48:34] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:34] [V] [TRT] Tactic: -3864869056275745423 time 6.42151 [07/23/2021-23:48:34] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:48:34] [V] [TRT] Tactic: -3601464762214218301 time 6.20531 [07/23/2021-23:48:34] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:34] [V] [TRT] Tactic: -3412636942650049698 time 5.78087 [07/23/2021-23:48:34] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:48:34] [V] [TRT] Tactic: -3058330359340425555 time 5.91526 [07/23/2021-23:48:34] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:48:34] [V] [TRT] Tactic: -2893013346565417259 time 6.3511 [07/23/2021-23:48:34] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:34] [V] [TRT] Tactic: -2816084650627734155 time 6.65011 [07/23/2021-23:48:34] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:34] [V] [TRT] Tactic: -2559894581585337900 time 4.67341 [07/23/2021-23:48:34] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:35] [V] [TRT] Tactic: -2241736083352441442 time 5.27654 [07/23/2021-23:48:35] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:35] [V] [TRT] Tactic: -1985778916402815946 time 6.65306 [07/23/2021-23:48:35] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:48:35] [V] [TRT] Tactic: -1979709471637578040 time 6.28891 [07/23/2021-23:48:35] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:48:35] [V] [TRT] Tactic: -1824906597022852312 time 4.78146 [07/23/2021-23:48:35] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:48:35] [V] [TRT] Tactic: -1727693334586194183 time 6.27341 [07/23/2021-23:48:35] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:48:35] [V] [TRT] Tactic: -1657270965825641606 time 5.20513 [07/23/2021-23:48:35] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:48:35] [V] [TRT] Tactic: -1500496213132463076 time 5.53139 [07/23/2021-23:48:35] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:48:35] [V] [TRT] Tactic: -1194193093145321861 time 8.36122 [07/23/2021-23:48:35] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:48:35] [V] [TRT] Tactic: -1099247066487349374 time 6.27315 [07/23/2021-23:48:35] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:48:35] [V] [TRT] Tactic: -705524612929044822 time 5.00084 [07/23/2021-23:48:35] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:48:36] [V] [TRT] Tactic: -680956411637736772 time 6.5751 [07/23/2021-23:48:36] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:48:36] [V] [TRT] Tactic: -504245585588397229 time 8.30912 [07/23/2021-23:48:36] [V] [TRT] Fastest Tactic: -5421613452990385135 Time: 4.62579 [07/23/2021-23:48:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CudaConvolution) [07/23/2021-23:48:37] [V] [TRT] Tactic: 0 time 56.0035 [07/23/2021-23:48:48] [V] [TRT] Tactic: 1 time 698.653 [07/23/2021-23:48:49] [V] [TRT] Tactic: 2 time 101.62 [07/23/2021-23:48:50] [V] [TRT] Tactic: 6 time 23.5071 [07/23/2021-23:48:51] [V] [TRT] Tactic: 56 time 56.4083 [07/23/2021-23:48:52] [V] [TRT] Tactic: 58 time 101.267 [07/23/2021-23:48:53] [V] [TRT] Tactic: 62 time 23.2536 [07/23/2021-23:48:53] [V] [TRT] Fastest Tactic: 62 Time: 23.2536 [07/23/2021-23:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CudaDepthwiseConvolution) [07/23/2021-23:48:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (CublasConvolution) [07/23/2021-23:48:53] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:48:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5421613452990385135 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:48:53] [V] [TRT] [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:48:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:48:53] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:48:53] [V] [TRT] Tactic: 1002 time 2.03418 [07/23/2021-23:48:53] [V] [TRT] Tactic: 0 time 14.2186 [07/23/2021-23:48:53] [V] [TRT] Fastest Tactic: 1002 Time: 2.03418 [07/23/2021-23:48:54] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:48:54] [V] [TRT] Tactic: 1002 time 2.63041 [07/23/2021-23:48:54] [V] [TRT] Tactic: 0 time 37.5672 [07/23/2021-23:48:54] [V] [TRT] Fastest Tactic: 1002 Time: 2.63041 [07/23/2021-23:48:55] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:48:55] [V] [TRT] Tactic: 1002 time 2.61965 [07/23/2021-23:48:56] [V] [TRT] Tactic: 0 time 37.5763 [07/23/2021-23:48:56] [V] [TRT] Fastest Tactic: 1002 Time: 2.61965 [07/23/2021-23:48:56] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:48:56] [V] [TRT] Tactic: 1002 time 2.89626 [07/23/2021-23:48:56] [V] [TRT] Tactic: 0 time 7.31546 [07/23/2021-23:48:56] [V] [TRT] Fastest Tactic: 1002 Time: 2.89626 [07/23/2021-23:48:56] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:48:56] [V] [TRT] Tactic: 1002 time 2.2528 [07/23/2021-23:48:56] [V] [TRT] Tactic: 0 time 1.82195 [07/23/2021-23:48:56] [V] [TRT] Fastest Tactic: 0 Time: 1.82195 [07/23/2021-23:48:56] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:48:56] [V] [TRT] Tactic: 1002 time 2.2473 [07/23/2021-23:48:56] [V] [TRT] Tactic: 0 time 1.81235 [07/23/2021-23:48:56] [V] [TRT] Fastest Tactic: 0 Time: 1.81235 [07/23/2021-23:48:56] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:48:57] [V] [TRT] Tactic: 1002 time 2.68019 [07/23/2021-23:48:57] [V] [TRT] Tactic: 0 time 6.4608 [07/23/2021-23:48:57] [V] [TRT] Fastest Tactic: 1002 Time: 2.68019 [07/23/2021-23:48:57] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:48:57] [V] [TRT] Tactic: 1002 time 2.3639 [07/23/2021-23:48:57] [V] [TRT] Tactic: 0 time 7.41683 [07/23/2021-23:48:57] [V] [TRT] Fastest Tactic: 1002 Time: 2.3639 [07/23/2021-23:48:57] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:48:57] [V] [TRT] Tactic: 1002 time 1.88813 [07/23/2021-23:48:57] [V] [TRT] Tactic: 0 time 1.3792 [07/23/2021-23:48:57] [V] [TRT] Fastest Tactic: 0 Time: 1.3792 [07/23/2021-23:48:57] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:48:57] [V] [TRT] Tactic: 1002 time 1.77754 [07/23/2021-23:48:58] [V] [TRT] Tactic: 0 time 13.6819 [07/23/2021-23:48:58] [V] [TRT] Fastest Tactic: 1002 Time: 1.77754 [07/23/2021-23:48:58] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:48:58] [V] [TRT] Tactic: 1002 time 1.65786 [07/23/2021-23:48:58] [V] [TRT] Tactic: 0 time 13.5488 [07/23/2021-23:48:58] [V] [TRT] Fastest Tactic: 1002 Time: 1.65786 [07/23/2021-23:48:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:48:59] [V] [TRT] Tactic: 1002 time 1.79981 [07/23/2021-23:48:59] [V] [TRT] Tactic: 0 time 29.4317 [07/23/2021-23:48:59] [V] [TRT] Fastest Tactic: 1002 Time: 1.79981 [07/23/2021-23:49:00] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,16777216) -> Float(1,2,512,1024,262144,16777216) *************** [07/23/2021-23:49:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/lambda/DepthToSpace (Shuffle) [07/23/2021-23:49:00] [V] [TRT] Tactic: 0 time 1.79763 [07/23/2021-23:49:00] [V] [TRT] Tactic: 1 time 16.0305 [07/23/2021-23:49:00] [V] [TRT] Fastest Tactic: 0 Time: 1.79763 [07/23/2021-23:49:00] [V] [TRT] *************** Autotuning format combination: Float(256,65536,1,16777216) -> Float(2,4,1,1024,262144,16777216) *************** [07/23/2021-23:49:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/lambda/DepthToSpace (Shuffle) [07/23/2021-23:49:00] [V] [TRT] Tactic: 0 time 13.078 [07/23/2021-23:49:00] [V] [TRT] Tactic: 1 time 14.5193 [07/23/2021-23:49:00] [V] [TRT] Fastest Tactic: 0 Time: 13.078 [07/23/2021-23:49:00] [V] [TRT] *************** Autotuning format combination: Float(64,16384,1:4,4194304) -> Float(1,2,1:4,512,131072,8388608) *************** [07/23/2021-23:49:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/lambda/DepthToSpace (Shuffle) [07/23/2021-23:49:01] [V] [TRT] Tactic: 0 time 17.7571 [07/23/2021-23:49:01] [V] [TRT] Tactic: 1 time 28.6003 [07/23/2021-23:49:01] [V] [TRT] Fastest Tactic: 0 Time: 17.7571 [07/23/2021-23:49:01] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536:32,524288) -> Float(1,2,512:32,512,131072,8388608) *************** [07/23/2021-23:49:01] [07/23/2021-23:49:01] [07/23/2021-23:49:01] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,16777216) -> Half(1,2,512,1024,262144,16777216) *************** [07/23/2021-23:49:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/lambda/DepthToSpace (Shuffle) [07/23/2021-23:49:01] [V] [TRT] Tactic: 0 time 1.20845 [07/23/2021-23:49:02] [V] [TRT] Tactic: 1 time 15.6292 [07/23/2021-23:49:02] [V] [TRT] Fastest Tactic: 0 Time: 1.20845 [07/23/2021-23:49:02] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,8388608) -> Half(1,2,512:2,512,131072,8388608) *************** [07/23/2021-23:49:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/lambda/DepthToSpace (Shuffle) [07/23/2021-23:49:02] [V] [TRT] Tactic: 0 time 1.65658 [07/23/2021-23:49:02] [V] [TRT] Tactic: 1 time 32.5125 [07/23/2021-23:49:02] [V] [TRT] Fastest Tactic: 0 Time: 1.65658 [07/23/2021-23:49:02] [V] [TRT] *************** Autotuning format combination: Half(32,8192,1:8,2097152) -> Half(1,2,1:8,512,131072,8388608) *************** [07/23/2021-23:49:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/lambda/DepthToSpace (Shuffle) [07/23/2021-23:49:03] [V] [TRT] Tactic: 0 time 15.9311 [07/23/2021-23:49:03] [V] [TRT] Tactic: 1 time 28.5468 [07/23/2021-23:49:03] [V] [TRT] Fastest Tactic: 0 Time: 15.9311 [07/23/2021-23:49:03] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:03] [V] [TRT] Tactic: 1002 time 10.0924 [07/23/2021-23:49:03] [V] [TRT] Tactic: 0 time 1.79046 [07/23/2021-23:49:03] [V] [TRT] Fastest Tactic: 0 Time: 1.79046 [07/23/2021-23:49:03] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:08] [V] [TRT] Tactic: 1002 time 293.249 [07/23/2021-23:49:08] [V] [TRT] Tactic: 0 time 8.50995 [07/23/2021-23:49:08] [V] [TRT] Fastest Tactic: 0 Time: 8.50995 [07/23/2021-23:49:08] [07/23/2021-23:49:08] [07/23/2021-23:49:08] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:09] [V] [TRT] Tactic: 1002 time 1.56467 [07/23/2021-23:49:09] [V] [TRT] Tactic: 0 time 1.80198 [07/23/2021-23:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 1.56467 [07/23/2021-23:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:09] [V] [TRT] Tactic: 1002 time 20.2006 [07/23/2021-23:49:09] [V] [TRT] Tactic: 0 time 1.2809 [07/23/2021-23:49:09] [V] [TRT] Fastest Tactic: 0 Time: 1.2809 [07/23/2021-23:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:14] [V] [TRT] Tactic: 1002 time 293.696 [07/23/2021-23:49:14] [V] [TRT] Tactic: 0 time 2.71718 [07/23/2021-23:49:14] [V] [TRT] Fastest Tactic: 0 Time: 2.71718 [07/23/2021-23:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:14] [V] [TRT] Tactic: 1002 time 10.5955 [07/23/2021-23:49:14] [V] [TRT] Tactic: 0 time 1.77894 [07/23/2021-23:49:14] [V] [TRT] Fastest Tactic: 0 Time: 1.77894 [07/23/2021-23:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:18] [V] [TRT] Tactic: 1002 time 219.475 [07/23/2021-23:49:18] [V] [TRT] Tactic: 0 time 8.51405 [07/23/2021-23:49:18] [V] [TRT] Fastest Tactic: 0 Time: 8.51405 [07/23/2021-23:49:18] [07/23/2021-23:49:18] [07/23/2021-23:49:18] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:18] [V] [TRT] Tactic: 1002 time 10.683 [07/23/2021-23:49:18] [V] [TRT] Tactic: 0 time 1.27642 [07/23/2021-23:49:18] [V] [TRT] Fastest Tactic: 0 Time: 1.27642 [07/23/2021-23:49:18] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:19] [V] [TRT] Tactic: 1002 time 14.2171 [07/23/2021-23:49:19] [V] [TRT] Tactic: 0 time 1.2864 [07/23/2021-23:49:19] [V] [TRT] Fastest Tactic: 0 Time: 1.2864 [07/23/2021-23:49:19] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:22] [V] [TRT] Tactic: 1002 time 218.398 [07/23/2021-23:49:22] [V] [TRT] Tactic: 0 time 8.42406 [07/23/2021-23:49:22] [V] [TRT] Fastest Tactic: 0 Time: 8.42406 [07/23/2021-23:49:22] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:26] [V] [TRT] Tactic: 1002 time 243.984 [07/23/2021-23:49:26] [V] [TRT] Tactic: 0 time 2.63949 [07/23/2021-23:49:26] [V] [TRT] Fastest Tactic: 0 Time: 2.63949 [07/23/2021-23:49:26] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:30] [V] [TRT] Tactic: 1002 time 219.623 [07/23/2021-23:49:30] [V] [TRT] Tactic: 0 time 2.65741 [07/23/2021-23:49:30] [V] [TRT] Fastest Tactic: 0 Time: 2.65741 [07/23/2021-23:49:30] [07/23/2021-23:49:30] [07/23/2021-23:49:30] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:34] [V] [TRT] Tactic: 1002 time 244.025 [07/23/2021-23:49:34] [V] [TRT] Tactic: 0 time 2.07642 [07/23/2021-23:49:34] [V] [TRT] Fastest Tactic: 0 Time: 2.07642 [07/23/2021-23:49:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:38] [V] [TRT] Tactic: 1002 time 218.518 [07/23/2021-23:49:38] [V] [TRT] Tactic: 0 time 2.07437 [07/23/2021-23:49:38] [V] [TRT] Fastest Tactic: 0 Time: 2.07437 [07/23/2021-23:49:38] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:41] [V] [TRT] Tactic: 1002 time 219.941 [07/23/2021-23:49:42] [V] [TRT] Tactic: 0 time 9.21792 [07/23/2021-23:49:42] [V] [TRT] Fastest Tactic: 0 Time: 9.21792 [07/23/2021-23:49:42] [07/23/2021-23:49:42] [07/23/2021-23:49:42] [07/23/2021-23:49:42] [07/23/2021-23:49:42] [07/23/2021-23:49:42] [07/23/2021-23:49:42] [07/23/2021-23:49:42] [07/23/2021-23:49:42] [07/23/2021-23:49:42] [07/23/2021-23:49:42] [07/23/2021-23:49:42] [07/23/2021-23:49:42] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:42] [V] [TRT] Tactic: 1002 time 1.63945 [07/23/2021-23:49:42] [V] [TRT] Tactic: 0 time 2.14131 [07/23/2021-23:49:42] [V] [TRT] Fastest Tactic: 1002 Time: 1.63945 [07/23/2021-23:49:42] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:42] [V] [TRT] Tactic: 1002 time 10.2036 [07/23/2021-23:49:42] [V] [TRT] Tactic: 0 time 1.38752 [07/23/2021-23:49:42] [V] [TRT] Fastest Tactic: 0 Time: 1.38752 [07/23/2021-23:49:42] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:47] [V] [TRT] Tactic: 1002 time 292.1 [07/23/2021-23:49:47] [V] [TRT] Tactic: 0 time 8.11328 [07/23/2021-23:49:47] [V] [TRT] Fastest Tactic: 0 Time: 8.11328 [07/23/2021-23:49:47] [07/23/2021-23:49:47] [07/23/2021-23:49:47] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:47] [V] [TRT] Tactic: 1002 time 20.3118 [07/23/2021-23:49:47] [V] [TRT] Tactic: 0 time 0.923776 [07/23/2021-23:49:47] [V] [TRT] Fastest Tactic: 0 Time: 0.923776 [07/23/2021-23:49:48] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:52] [V] [TRT] Tactic: 1002 time 293.902 [07/23/2021-23:49:52] [V] [TRT] Tactic: 0 time 2.30067 [07/23/2021-23:49:52] [V] [TRT] Fastest Tactic: 0 Time: 2.30067 [07/23/2021-23:49:52] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:52] [V] [TRT] Tactic: 1002 time 2.72947 [07/23/2021-23:49:52] [V] [TRT] Tactic: 0 time 1.30739 [07/23/2021-23:49:52] [V] [TRT] Fastest Tactic: 0 Time: 1.30739 [07/23/2021-23:49:53] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:53] [V] [TRT] Tactic: 1002 time 14.0191 [07/23/2021-23:49:53] [V] [TRT] Tactic: 0 time 1.35424 [07/23/2021-23:49:53] [V] [TRT] Fastest Tactic: 0 Time: 1.35424 [07/23/2021-23:49:53] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:56] [V] [TRT] Tactic: 1002 time 218.169 [07/23/2021-23:49:57] [V] [TRT] Tactic: 0 time 8.05939 [07/23/2021-23:49:57] [V] [TRT] Fastest Tactic: 0 Time: 8.05939 [07/23/2021-23:49:57] [07/23/2021-23:49:57] [07/23/2021-23:49:57] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:49:57] [V] [TRT] Tactic: 1002 time 2.64717 [07/23/2021-23:49:57] [V] [TRT] Tactic: 0 time 0.913152 [07/23/2021-23:49:57] [V] [TRT] Fastest Tactic: 0 Time: 0.913152 [07/23/2021-23:49:57] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:00] [V] [TRT] Tactic: 1002 time 218.867 [07/23/2021-23:50:00] [V] [TRT] Tactic: 0 time 2.3145 [07/23/2021-23:50:00] [V] [TRT] Fastest Tactic: 0 Time: 2.3145 [07/23/2021-23:50:00] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:04] [V] [TRT] Tactic: 1002 time 245.631 [07/23/2021-23:50:04] [V] [TRT] Tactic: 0 time 2.67123 [07/23/2021-23:50:04] [V] [TRT] Fastest Tactic: 0 Time: 2.67123 [07/23/2021-23:50:04] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:08] [V] [TRT] Tactic: 1002 time 219.413 [07/23/2021-23:50:08] [V] [TRT] Tactic: 0 time 2.65549 [07/23/2021-23:50:08] [V] [TRT] Fastest Tactic: 0 Time: 2.65549 [07/23/2021-23:50:08] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:12] [V] [TRT] Tactic: 1002 time 220.474 [07/23/2021-23:50:12] [V] [TRT] Tactic: 0 time 9.32966 [07/23/2021-23:50:12] [V] [TRT] Fastest Tactic: 0 Time: 9.32966 [07/23/2021-23:50:12] [07/23/2021-23:50:12] [07/23/2021-23:50:12] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:16] [V] [TRT] Tactic: 1002 time 245.777 [07/23/2021-23:50:16] [V] [TRT] Tactic: 0 time 2.07846 [07/23/2021-23:50:16] [V] [TRT] Fastest Tactic: 0 Time: 2.07846 [07/23/2021-23:50:16] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:20] [V] [TRT] Tactic: 1002 time 220.535 [07/23/2021-23:50:20] [V] [TRT] Tactic: 0 time 2.0768 [07/23/2021-23:50:20] [V] [TRT] Fastest Tactic: 0 Time: 2.0768 [07/23/2021-23:50:20] [V] [TRT] *************** Autotuning format combination: Float(1,2,512,1024,262144,16777216) -> Float(1,512,262144,16777216) *************** [07/23/2021-23:50:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 263) [Shuffle] (Shuffle) [07/23/2021-23:50:20] [V] [TRT] Tactic: 0 time 1.79699 [07/23/2021-23:50:20] [V] [TRT] Tactic: 1 time 4.03802 [07/23/2021-23:50:20] [V] [TRT] Fastest Tactic: 0 Time: 1.79699 [07/23/2021-23:50:20] [V] [TRT] *************** Autotuning format combination: Float(2,4,1,1024,262144,16777216) -> Float(64,32768,1,16777216) *************** [07/23/2021-23:50:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 263) [Shuffle] (Shuffle) [07/23/2021-23:50:20] [V] [TRT] Tactic: 0 time 5.21088 [07/23/2021-23:50:20] [V] [TRT] Tactic: 1 time 12.6579 [07/23/2021-23:50:20] [V] [TRT] Fastest Tactic: 0 Time: 5.21088 [07/23/2021-23:50:20] [V] [TRT] *************** Autotuning format combination: Float(1,2,1:4,512,131072,8388608) -> Float(16,8192,1:4,4194304) *************** [07/23/2021-23:50:20] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 263) [Shuffle] (Shuffle) [07/23/2021-23:50:21] [V] [TRT] Tactic: 0 time 7.34451 [07/23/2021-23:50:21] [V] [TRT] Tactic: 1 time 32.5125 [07/23/2021-23:50:21] [V] [TRT] Fastest Tactic: 0 Time: 7.34451 [07/23/2021-23:50:21] [V] [TRT] *************** Autotuning format combination: Float(1,2,512:32,512,131072,8388608) -> Float(1,512,262144:32,524288) *************** [07/23/2021-23:50:21] [07/23/2021-23:50:21] [07/23/2021-23:50:21] [V] [TRT] *************** Autotuning format combination: Half(1,2,512,1024,262144,16777216) -> Half(1,512,262144,16777216) *************** [07/23/2021-23:50:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 263) [Shuffle] (Shuffle) [07/23/2021-23:50:21] [V] [TRT] Tactic: 0 time 0.90432 [07/23/2021-23:50:21] [V] [TRT] Tactic: 1 time 2.5033 [07/23/2021-23:50:21] [V] [TRT] Fastest Tactic: 0 Time: 0.90432 [07/23/2021-23:50:21] [V] [TRT] *************** Autotuning format combination: Half(1,2,512:2,512,131072,8388608) -> Half(1,512,262144:2,8388608) *************** [07/23/2021-23:50:21] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 263) [Shuffle] (Shuffle) [07/23/2021-23:50:21] [V] [TRT] Tactic: 0 time 1.66515 [07/23/2021-23:50:22] [V] [TRT] Tactic: 1 time 7.51629 [07/23/2021-23:50:22] [V] [TRT] Fastest Tactic: 0 Time: 1.66515 [07/23/2021-23:50:22] [V] [TRT] *************** Autotuning format combination: Half(1,2,1:8,512,131072,8388608) -> Half(8,4096,1:8,2097152) *************** [07/23/2021-23:50:22] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 263) [Shuffle] (Shuffle) [07/23/2021-23:50:22] [V] [TRT] Tactic: 0 time 6.64858 [07/23/2021-23:50:22] [V] [TRT] Tactic: 1 time 32.7908 [07/23/2021-23:50:22] [V] [TRT] Fastest Tactic: 0 Time: 6.64858 [07/23/2021-23:50:22] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:22] [V] [TRT] Tactic: 1002 time 1.99245 [07/23/2021-23:50:22] [V] [TRT] Tactic: 0 time 4.19123 [07/23/2021-23:50:22] [V] [TRT] Fastest Tactic: 1002 Time: 1.99245 [07/23/2021-23:50:22] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:23] [V] [TRT] Tactic: 1002 time 2.0407 [07/23/2021-23:50:23] [V] [TRT] Tactic: 0 time 4.128 [07/23/2021-23:50:23] [V] [TRT] Fastest Tactic: 1002 Time: 2.0407 [07/23/2021-23:50:23] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:23] [V] [TRT] Tactic: 1002 time 1.56531 [07/23/2021-23:50:23] [V] [TRT] Tactic: 0 time 1.79942 [07/23/2021-23:50:23] [V] [TRT] Fastest Tactic: 1002 Time: 1.56531 [07/23/2021-23:50:23] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:23] [V] [TRT] Tactic: 1002 time 4.47514 [07/23/2021-23:50:23] [V] [TRT] Tactic: 0 time 1.27821 [07/23/2021-23:50:23] [V] [TRT] Fastest Tactic: 0 Time: 1.27821 [07/23/2021-23:50:23] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:23] [V] [TRT] Tactic: 1002 time 1.68038 [07/23/2021-23:50:23] [V] [TRT] Tactic: 0 time 1.35104 [07/23/2021-23:50:23] [V] [TRT] Fastest Tactic: 0 Time: 1.35104 [07/23/2021-23:50:23] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:23] [V] [TRT] Tactic: 1002 time 1.96557 [07/23/2021-23:50:23] [V] [TRT] Tactic: 0 time 11.2314 [07/23/2021-23:50:23] [V] [TRT] Fastest Tactic: 1002 Time: 1.96557 [07/23/2021-23:50:23] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:24] [V] [TRT] Tactic: 1002 time 5.06112 [07/23/2021-23:50:24] [V] [TRT] Tactic: 0 time 1.78342 [07/23/2021-23:50:24] [V] [TRT] Fastest Tactic: 0 Time: 1.78342 [07/23/2021-23:50:24] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:24] [V] [TRT] Tactic: 1002 time 1.5456 [07/23/2021-23:50:24] [V] [TRT] Tactic: 0 time 11.0058 [07/23/2021-23:50:24] [V] [TRT] Fastest Tactic: 1002 Time: 1.5456 [07/23/2021-23:50:24] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:24] [V] [TRT] Tactic: 1002 time 3.7431 [07/23/2021-23:50:24] [V] [TRT] Tactic: 0 time 12.3464 [07/23/2021-23:50:24] [V] [TRT] Fastest Tactic: 1002 Time: 3.7431 [07/23/2021-23:50:24] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:24] [V] [TRT] Tactic: 1002 time 5.12602 [07/23/2021-23:50:24] [V] [TRT] Tactic: 0 time 1.29165 [07/23/2021-23:50:24] [V] [TRT] Fastest Tactic: 0 Time: 1.29165 [07/23/2021-23:50:25] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:25] [V] [TRT] Tactic: 1002 time 2.06336 [07/23/2021-23:50:25] [V] [TRT] Tactic: 0 time 11.2461 [07/23/2021-23:50:25] [V] [TRT] Fastest Tactic: 1002 Time: 2.06336 [07/23/2021-23:50:25] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:25] [V] [TRT] Tactic: 1002 time 5.0985 [07/23/2021-23:50:25] [V] [TRT] Tactic: 0 time 1.79098 [07/23/2021-23:50:25] [V] [TRT] Fastest Tactic: 0 Time: 1.79098 [07/23/2021-23:50:25] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:25] [V] [TRT] Tactic: 1002 time 1.69178 [07/23/2021-23:50:25] [V] [TRT] Tactic: 0 time 10.9284 [07/23/2021-23:50:25] [V] [TRT] Fastest Tactic: 1002 Time: 1.69178 [07/23/2021-23:50:25] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:25] [V] [TRT] Tactic: 1002 time 3.76179 [07/23/2021-23:50:26] [V] [TRT] Tactic: 0 time 12.3368 [07/23/2021-23:50:26] [V] [TRT] Fastest Tactic: 1002 Time: 3.76179 [07/23/2021-23:50:26] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:26] [V] [TRT] Tactic: 1002 time 5.04986 [07/23/2021-23:50:26] [V] [TRT] Tactic: 0 time 1.33299 [07/23/2021-23:50:26] [V] [TRT] Fastest Tactic: 0 Time: 1.33299 [07/23/2021-23:50:26] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:26] [V] [TRT] Tactic: 1002 time 7.00851 [07/23/2021-23:50:26] [V] [TRT] Tactic: 0 time 9.66131 [07/23/2021-23:50:26] [V] [TRT] Fastest Tactic: 1002 Time: 7.00851 [07/23/2021-23:50:26] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:26] [V] [TRT] Tactic: 1002 time 2.21158 [07/23/2021-23:50:26] [V] [TRT] Tactic: 0 time 1.79725 [07/23/2021-23:50:26] [V] [TRT] Fastest Tactic: 0 Time: 1.79725 [07/23/2021-23:50:26] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:27] [V] [TRT] Tactic: 1002 time 2.21261 [07/23/2021-23:50:27] [V] [TRT] Tactic: 0 time 1.79405 [07/23/2021-23:50:27] [V] [TRT] Fastest Tactic: 0 Time: 1.79405 [07/23/2021-23:50:27] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:27] [V] [TRT] Tactic: 1002 time 7.63251 [07/23/2021-23:50:27] [V] [TRT] Tactic: 0 time 9.26118 [07/23/2021-23:50:27] [V] [TRT] Fastest Tactic: 1002 Time: 7.63251 [07/23/2021-23:50:27] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:27] [V] [TRT] Tactic: 1002 time 3.78867 [07/23/2021-23:50:27] [V] [TRT] Tactic: 0 time 10.6092 [07/23/2021-23:50:27] [V] [TRT] Fastest Tactic: 1002 Time: 3.78867 [07/23/2021-23:50:27] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:27] [V] [TRT] Tactic: 1002 time 1.79814 [07/23/2021-23:50:27] [V] [TRT] Tactic: 0 time 1.35616 [07/23/2021-23:50:27] [V] [TRT] Fastest Tactic: 0 Time: 1.35616 [07/23/2021-23:50:27] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:28] [V] [TRT] Tactic: 1002 time 1.63994 [07/23/2021-23:50:28] [V] [TRT] Tactic: 0 time 2.14221 [07/23/2021-23:50:28] [V] [TRT] Fastest Tactic: 1002 Time: 1.63994 [07/23/2021-23:50:28] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:28] [V] [TRT] Tactic: 1002 time 1.57632 [07/23/2021-23:50:28] [V] [TRT] Tactic: 0 time 3.26656 [07/23/2021-23:50:28] [V] [TRT] Fastest Tactic: 1002 Time: 1.57632 [07/23/2021-23:50:28] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:28] [V] [TRT] Tactic: 1002 time 1.78266 [07/23/2021-23:50:28] [V] [TRT] Tactic: 0 time 3.36563 [07/23/2021-23:50:28] [V] [TRT] Fastest Tactic: 1002 Time: 1.78266 [07/23/2021-23:50:28] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:28] [V] [TRT] Tactic: 1002 time 4.39501 [07/23/2021-23:50:28] [V] [TRT] Tactic: 0 time 0.935552 [07/23/2021-23:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.935552 [07/23/2021-23:50:28] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:28] [V] [TRT] Tactic: 1002 time 1.62867 [07/23/2021-23:50:28] [V] [TRT] Tactic: 0 time 0.942848 [07/23/2021-23:50:28] [V] [TRT] Fastest Tactic: 0 Time: 0.942848 [07/23/2021-23:50:28] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:28] [V] [TRT] Tactic: 1002 time 2.71142 [07/23/2021-23:50:28] [V] [TRT] Tactic: 0 time 1.40365 [07/23/2021-23:50:28] [V] [TRT] Fastest Tactic: 0 Time: 1.40365 [07/23/2021-23:50:28] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:28] [V] [TRT] Tactic: 1002 time 1.6736 [07/23/2021-23:50:29] [V] [TRT] Tactic: 0 time 1.63059 [07/23/2021-23:50:29] [V] [TRT] Fastest Tactic: 0 Time: 1.63059 [07/23/2021-23:50:29] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:29] [V] [TRT] Tactic: 1002 time 1.67501 [07/23/2021-23:50:29] [V] [TRT] Tactic: 0 time 1.6713 [07/23/2021-23:50:29] [V] [TRT] Fastest Tactic: 0 Time: 1.6713 [07/23/2021-23:50:29] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:29] [V] [TRT] Tactic: 1002 time 2.61261 [07/23/2021-23:50:29] [V] [TRT] Tactic: 0 time 0.862208 [07/23/2021-23:50:29] [V] [TRT] Fastest Tactic: 0 Time: 0.862208 [07/23/2021-23:50:29] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:29] [V] [TRT] Tactic: 1002 time 1.57542 [07/23/2021-23:50:29] [V] [TRT] Tactic: 0 time 0.974592 [07/23/2021-23:50:29] [V] [TRT] Fastest Tactic: 0 Time: 0.974592 [07/23/2021-23:50:29] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:29] [V] [TRT] Tactic: 1002 time 1.72198 [07/23/2021-23:50:29] [V] [TRT] Tactic: 0 time 1.38432 [07/23/2021-23:50:29] [V] [TRT] Fastest Tactic: 0 Time: 1.38432 [07/23/2021-23:50:29] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:29] [V] [TRT] Tactic: 1002 time 5.14624 [07/23/2021-23:50:29] [V] [TRT] Tactic: 0 time 1.34886 [07/23/2021-23:50:29] [V] [TRT] Fastest Tactic: 0 Time: 1.34886 [07/23/2021-23:50:29] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:29] [V] [TRT] Tactic: 1002 time 5.136 [07/23/2021-23:50:29] [V] [TRT] Tactic: 0 time 1.37741 [07/23/2021-23:50:29] [V] [TRT] Fastest Tactic: 0 Time: 1.37741 [07/23/2021-23:50:30] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:30] [V] [TRT] Tactic: 1002 time 1.60653 [07/23/2021-23:50:30] [V] [TRT] Tactic: 0 time 0.90432 [07/23/2021-23:50:30] [V] [TRT] Fastest Tactic: 0 Time: 0.90432 [07/23/2021-23:50:30] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:50:30] [V] [TRT] Tactic: 1002 time 4.06592 [07/23/2021-23:50:30] [V] [TRT] Tactic: 0 time 0.899968 [07/23/2021-23:50:30] [V] [TRT] Fastest Tactic: 0 Time: 0.899968 [07/23/2021-23:50:30] [V] [TRT] *************** Autotuning format combination: Float(1,512,262144,16777216) -> Float(1,512,262144,67108864) *************** [07/23/2021-23:50:30] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 [07/23/2021-23:50:30] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 [07/23/2021-23:50:30] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 [07/23/2021-23:50:30] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 [07/23/2021-23:50:30] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 [07/23/2021-23:50:30] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 [07/23/2021-23:50:30] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 [07/23/2021-23:50:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (FusedConvActConvolution) [07/23/2021-23:50:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:50:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CaskConvolution) [07/23/2021-23:50:30] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 [07/23/2021-23:50:30] [V] [TRT] Tactic: 4549827808004681195 time 34.2858 [07/23/2021-23:50:30] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 [07/23/2021-23:50:31] [V] [TRT] Tactic: 5779835512569528575 time 31.1423 [07/23/2021-23:50:31] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 [07/23/2021-23:50:32] [V] [TRT] Tactic: 6053873026024413720 time 33.3077 [07/23/2021-23:50:32] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 [07/23/2021-23:50:32] [V] [TRT] Tactic: 6767548733843469815 time 33.3838 [07/23/2021-23:50:32] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 [07/23/2021-23:50:33] [V] [TRT] Tactic: -6313876406580483184 time 37.8561 [07/23/2021-23:50:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 [07/23/2021-23:50:33] [V] [TRT] Tactic: -1123676555321336786 time 31.438 [07/23/2021-23:50:33] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 [07/23/2021-23:50:34] [V] [TRT] Tactic: -701551393537224327 time 34.9859 [07/23/2021-23:50:34] [V] [TRT] Fastest Tactic: 5779835512569528575 Time: 31.1423 [07/23/2021-23:50:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CudaConvolution) [07/23/2021-23:50:35] [V] [TRT] Tactic: 0 time 55.167 [07/23/2021-23:50:35] [V] [TRT] Tactic: 1 time 29.0648 [07/23/2021-23:50:36] [V] [TRT] Tactic: 2 time 61.6303 [07/23/2021-23:50:37] [V] [TRT] Tactic: 5 time 79.209 [07/23/2021-23:50:38] [V] [TRT] Tactic: 6 time 36.46 [07/23/2021-23:50:39] [V] [TRT] Tactic: 56 time 54.9147 [07/23/2021-23:50:39] [V] [TRT] Tactic: 57 time 29.0993 [07/23/2021-23:50:40] [V] [TRT] Tactic: 58 time 61.12 [07/23/2021-23:50:42] [V] [TRT] Tactic: 61 time 79.2918 [07/23/2021-23:50:42] [V] [TRT] Tactic: 62 time 36.4827 [07/23/2021-23:50:43] [V] [TRT] Tactic: 112 time 55.1907 [07/23/2021-23:50:44] [V] [TRT] Tactic: 113 time 47.8386 [07/23/2021-23:50:45] [V] [TRT] Tactic: 114 time 61.7412 [07/23/2021-23:50:46] [V] [TRT] Tactic: 117 time 79.298 [07/23/2021-23:50:47] [V] [TRT] Tactic: 118 time 36.3843 [07/23/2021-23:50:47] [V] [TRT] Fastest Tactic: 1 Time: 29.0648 [07/23/2021-23:50:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CudaDepthwiseConvolution) [07/23/2021-23:50:47] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:50:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CublasConvolution) [07/23/2021-23:50:47] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:50:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [07/23/2021-23:50:47] [V] [TRT] [07/23/2021-23:50:47] [V] [TRT] *************** Autotuning format combination: Float(64,32768,1,16777216) -> Float(256,131072,1,67108864) *************** [07/23/2021-23:50:47] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:47] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:47] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:47] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:47] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:47] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:50:47] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:47] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:50:47] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:50:47] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:47] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (FusedConvActConvolution) [07/23/2021-23:50:47] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:50:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CaskConvolution) [07/23/2021-23:50:47] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:48] [V] [TRT] Tactic: 2860655430572478466 time 33.7124 [07/23/2021-23:50:48] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:48] [V] [TRT] Tactic: 4474630279712975759 time 37.8272 [07/23/2021-23:50:48] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:49] [V] [TRT] Tactic: 4479823862704990365 time 37.2636 [07/23/2021-23:50:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:49] [V] [TRT] Tactic: 4696204239951173149 time 33.6883 [07/23/2021-23:50:49] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:50] [V] [TRT] Tactic: 5778138195697110003 time 32.1279 [07/23/2021-23:50:50] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:50:50] [V] [TRT] Tactic: 7155825427510256858 time 31.755 [07/23/2021-23:50:50] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:51] [V] [TRT] Tactic: 8918020581761223752 time 31.582 [07/23/2021-23:50:51] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:50:51] [V] [TRT] Tactic: -4756382386362004279 time 33.7399 [07/23/2021-23:50:51] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:50:52] [V] [TRT] Tactic: -3855385237722507464 time 32.6039 [07/23/2021-23:50:52] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] Tactic: -2809379259463049391 time 32.6979 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] Tactic: -504296718212024303 time 31.582 [07/23/2021-23:50:53] [V] [TRT] Fastest Tactic: -504296718212024303 Time: 31.582 [07/23/2021-23:50:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CudaConvolution) [07/23/2021-23:50:53] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:50:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CudaDepthwiseConvolution) [07/23/2021-23:50:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:50:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CublasConvolution) [07/23/2021-23:50:53] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:50:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -504296718212024303 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] *************** Autotuning format combination: Float(16,8192,1:4,4194304) -> Float(64,32768,1:4,16777216) *************** [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (FusedConvActConvolution) [07/23/2021-23:50:53] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:50:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CaskConvolution) [07/23/2021-23:50:53] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:54] [V] [TRT] Tactic: 2860655430572478466 time 33.5959 [07/23/2021-23:50:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:54] [V] [TRT] Tactic: 4474630279712975759 time 37.7668 [07/23/2021-23:50:54] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:55] [V] [TRT] Tactic: 4479823862704990365 time 37.3032 [07/23/2021-23:50:55] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:56] [V] [TRT] Tactic: 4696204239951173149 time 33.8176 [07/23/2021-23:50:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:56] [V] [TRT] Tactic: 5778138195697110003 time 32.2847 [07/23/2021-23:50:56] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:50:57] [V] [TRT] Tactic: 7155825427510256858 time 31.7556 [07/23/2021-23:50:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:57] [V] [TRT] Tactic: 8918020581761223752 time 31.66 [07/23/2021-23:50:57] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:50:58] [V] [TRT] Tactic: -4756382386362004279 time 33.642 [07/23/2021-23:50:58] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:50:58] [V] [TRT] Tactic: -3855385237722507464 time 32.801 [07/23/2021-23:50:58] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:59] [V] [TRT] Tactic: -2809379259463049391 time 32.5525 [07/23/2021-23:50:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:59] [V] [TRT] Tactic: -504296718212024303 time 31.6165 [07/23/2021-23:50:59] [V] [TRT] Fastest Tactic: -504296718212024303 Time: 31.6165 [07/23/2021-23:50:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CudaConvolution) [07/23/2021-23:50:59] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:50:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CudaDepthwiseConvolution) [07/23/2021-23:50:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:50:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CublasConvolution) [07/23/2021-23:50:59] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:50:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -504296718212024303 [07/23/2021-23:50:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:59] [V] [TRT] [07/23/2021-23:50:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:50:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:50:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:50:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:50:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:50:59] [V] [TRT] *************** Autotuning format combination: Half(1,512,262144,16777216) -> Half(1,512,262144,67108864) *************** [07/23/2021-23:50:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (FusedConvActConvolution) [07/23/2021-23:50:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:50:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CaskConvolution) [07/23/2021-23:50:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/23/2021-23:50:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CudaConvolution) [07/23/2021-23:51:00] [V] [TRT] Tactic: 0 time 66.3681 [07/23/2021-23:51:01] [V] [TRT] Tactic: 1 time 66.5099 [07/23/2021-23:51:02] [V] [TRT] Tactic: 2 time 52.2213 [07/23/2021-23:51:03] [V] [TRT] Tactic: 5 time 70.6454 [07/23/2021-23:51:04] [V] [TRT] Tactic: 6 time 36.9617 [07/23/2021-23:51:05] [V] [TRT] Tactic: 56 time 66.4498 [07/23/2021-23:51:06] [V] [TRT] Tactic: 58 time 51.9597 [07/23/2021-23:51:07] [V] [TRT] Tactic: 61 time 70.5953 [07/23/2021-23:51:08] [V] [TRT] Tactic: 62 time 36.8342 [07/23/2021-23:51:08] [V] [TRT] Fastest Tactic: 62 Time: 36.8342 [07/23/2021-23:51:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CudaDepthwiseConvolution) [07/23/2021-23:51:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:51:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CublasConvolution) [07/23/2021-23:51:08] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:51:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 62 [07/23/2021-23:51:08] [V] [TRT] [07/23/2021-23:51:08] [V] [TRT] *************** Autotuning format combination: Half(1,512,262144:2,8388608) -> Half(1,512,262144:2,33554432) *************** [07/23/2021-23:51:08] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:51:08] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:51:08] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:51:08] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:51:08] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:51:08] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:51:08] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:51:08] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:51:08] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:51:08] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:51:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (FusedConvActConvolution) [07/23/2021-23:51:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:51:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CaskConvolution) [07/23/2021-23:51:08] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:51:08] [V] [TRT] Tactic: 2195670545862694453 time 20.3867 [07/23/2021-23:51:08] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:51:09] [V] [TRT] Tactic: 3419182076704469245 time 19.3018 [07/23/2021-23:51:09] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:51:09] [V] [TRT] Tactic: 3891805945559659536 time 19.4138 [07/23/2021-23:51:09] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:51:09] [V] [TRT] Tactic: 5548126322150286555 time 18.978 [07/23/2021-23:51:09] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:51:09] [V] [TRT] Tactic: 6057304366605292508 time 18.8558 [07/23/2021-23:51:09] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:51:10] [V] [TRT] Tactic: -7928611605886347652 time 19.7623 [07/23/2021-23:51:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:51:10] [V] [TRT] Tactic: -5172391392092686714 time 20.4627 [07/23/2021-23:51:10] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:51:11] [V] [TRT] Tactic: -4374269919094467161 time 20.2147 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:51:11] [V] [TRT] Tactic: -4083394051665370953 time 12.3215 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:51:11] [V] [TRT] Tactic: -1546027692247304867 time 19.2948 [07/23/2021-23:51:11] [V] [TRT] Fastest Tactic: -4083394051665370953 Time: 12.3215 [07/23/2021-23:51:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CudaConvolution) [07/23/2021-23:51:11] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:51:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CudaDepthwiseConvolution) [07/23/2021-23:51:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:51:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CublasConvolution) [07/23/2021-23:51:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:51:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4083394051665370953 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:51:11] [V] [TRT] [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:51:11] [V] [TRT] *************** Autotuning format combination: Half(8,4096,1:8,2097152) -> Float(1,512,262144,67108864) *************** [07/23/2021-23:51:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (FusedConvActConvolution) [07/23/2021-23:51:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:51:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CaskConvolution) [07/23/2021-23:51:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/23/2021-23:51:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CudaConvolution) [07/23/2021-23:51:11] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:51:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CudaDepthwiseConvolution) [07/23/2021-23:51:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:51:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CublasConvolution) [07/23/2021-23:51:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:51:11] [V] [TRT] *************** Autotuning format combination: Half(8,4096,1:8,2097152) -> Half(32,16384,1:8,8388608) *************** [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:51:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (FusedConvActConvolution) [07/23/2021-23:51:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:51:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CaskConvolution) [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] Tactic: 254850674756030979 time 6.35713 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:11] [V] [TRT] Tactic: 1156328698016730421 time 5.41404 [07/23/2021-23:51:11] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:51:12] [V] [TRT] Tactic: 1584305878200231339 time 6.14925 [07/23/2021-23:51:12] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:51:12] [V] [TRT] Tactic: 1832046141070096030 time 7.41696 [07/23/2021-23:51:12] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:51:12] [V] [TRT] Tactic: 1838082074606840426 time 7.48762 [07/23/2021-23:51:12] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:51:12] [V] [TRT] Tactic: 1899296423087490472 time 9.70304 [07/23/2021-23:51:12] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:51:12] [V] [TRT] Tactic: 2338136297163812551 time 6.0823 [07/23/2021-23:51:12] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:12] [V] [TRT] Tactic: 2541579301352125276 time 6.13811 [07/23/2021-23:51:12] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:51:12] [V] [TRT] Tactic: 2657157263811141609 time 9.97875 [07/23/2021-23:51:12] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:51:12] [V] [TRT] Tactic: 2819719497590964443 time 7.83706 [07/23/2021-23:51:12] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:51:13] [V] [TRT] Tactic: 2835786846016979545 time 15.5013 [07/23/2021-23:51:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:51:13] [V] [TRT] Tactic: 2968605903460894194 time 7.33005 [07/23/2021-23:51:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:13] [V] [TRT] Tactic: 2986078304285316765 time 6.1015 [07/23/2021-23:51:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:51:13] [V] [TRT] Tactic: 3362537467505018070 time 5.92832 [07/23/2021-23:51:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:13] [V] [TRT] Tactic: 3513075359009385578 time 5.57658 [07/23/2021-23:51:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:51:13] [V] [TRT] Tactic: 3546424067684403057 time 15.5835 [07/23/2021-23:51:13] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:51:14] [V] [TRT] Tactic: 3573559043797674382 time 7.27169 [07/23/2021-23:51:14] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:14] [V] [TRT] Tactic: 3704534001553878387 time 5.24083 [07/23/2021-23:51:14] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:51:14] [V] [TRT] Tactic: 4278315135102886928 time 7.3129 [07/23/2021-23:51:14] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:51:14] [V] [TRT] Tactic: 4750655167565104065 time 6.73281 [07/23/2021-23:51:14] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:14] [V] [TRT] Tactic: 4802447371470387646 time 7.5127 [07/23/2021-23:51:14] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:14] [V] [TRT] Tactic: 5059676457552313631 time 6.41024 [07/23/2021-23:51:14] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:14] [V] [TRT] Tactic: 5398999388616959893 time 6.48819 [07/23/2021-23:51:14] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:51:14] [V] [TRT] Tactic: 5579149726397848560 time 6.17101 [07/23/2021-23:51:14] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:51:15] [V] [TRT] Tactic: 5746691132547383910 time 7.58682 [07/23/2021-23:51:15] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:15] [V] [TRT] Tactic: 5770170567977052602 time 7.58362 [07/23/2021-23:51:15] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:51:15] [V] [TRT] Tactic: 5896806418498994339 time 10.0649 [07/23/2021-23:51:15] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:51:15] [V] [TRT] Tactic: 6034364043891107501 time 7.14958 [07/23/2021-23:51:15] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:51:15] [V] [TRT] Tactic: 6074229447555668232 time 9.79098 [07/23/2021-23:51:15] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:51:15] [V] [TRT] Tactic: 6176524653920166422 time 7.32774 [07/23/2021-23:51:15] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:51:15] [V] [TRT] Tactic: 6272216432116166416 time 6.23232 [07/23/2021-23:51:15] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:51:15] [V] [TRT] Tactic: 6377497238381488891 time 6.01613 [07/23/2021-23:51:15] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:51:16] [V] [TRT] Tactic: 6428823438254963239 time 8.06131 [07/23/2021-23:51:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:51:16] [V] [TRT] Tactic: 6446388116965632819 time 7.49325 [07/23/2021-23:51:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:51:16] [V] [TRT] Tactic: 6468794451065529747 time 7.71034 [07/23/2021-23:51:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:16] [V] [TRT] Tactic: 6642277870194067185 time 5.79072 [07/23/2021-23:51:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:51:16] [V] [TRT] Tactic: 6725284471687256210 time 9.93498 [07/23/2021-23:51:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:51:16] [V] [TRT] Tactic: 6859477213531075460 time 9.14765 [07/23/2021-23:51:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:51:16] [V] [TRT] Tactic: 7100752989500049598 time 9.96429 [07/23/2021-23:51:16] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:17] [V] [TRT] Tactic: 7216571380637776659 time 5.7824 [07/23/2021-23:51:17] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:51:17] [V] [TRT] Tactic: 7609923741161019135 time 7.46306 [07/23/2021-23:51:17] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:51:17] [V] [TRT] Tactic: 7667554089956651578 time 7.23418 [07/23/2021-23:51:17] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:51:17] [V] [TRT] Tactic: 7705739241028240201 time 10.1554 [07/23/2021-23:51:17] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:51:17] [V] [TRT] Tactic: 8040838497444300918 time 10.4867 [07/23/2021-23:51:17] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:51:17] [V] [TRT] Tactic: 8101703987960976805 time 10.1155 [07/23/2021-23:51:17] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:51:17] [V] [TRT] Tactic: 8170606396342855895 time 7.65683 [07/23/2021-23:51:17] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:51:18] [V] [TRT] Tactic: 8264928564315835356 time 6.11508 [07/23/2021-23:51:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:18] [V] [TRT] Tactic: 8839784824303350101 time 5.57339 [07/23/2021-23:51:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:51:18] [V] [TRT] Tactic: -9217371357561775773 time 10.3507 [07/23/2021-23:51:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:18] [V] [TRT] Tactic: -9009272790678027912 time 7.65517 [07/23/2021-23:51:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:51:18] [V] [TRT] Tactic: -8949544755481315679 time 7.47635 [07/23/2021-23:51:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:51:18] [V] [TRT] Tactic: -8604374562669615024 time 9.62381 [07/23/2021-23:51:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:51:18] [V] [TRT] Tactic: -7938306756270351617 time 6.49358 [07/23/2021-23:51:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:51:18] [V] [TRT] Tactic: -7027328628217650515 time 5.66043 [07/23/2021-23:51:18] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:51:19] [V] [TRT] Tactic: -6840588038605932325 time 7.45805 [07/23/2021-23:51:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:51:19] [V] [TRT] Tactic: -6603588435230240365 time 6.6249 [07/23/2021-23:51:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:51:19] [V] [TRT] Tactic: -6356316196810535311 time 10.3444 [07/23/2021-23:51:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:19] [V] [TRT] Tactic: -6257787336162086472 time 5.46637 [07/23/2021-23:51:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:51:19] [V] [TRT] Tactic: -6063766379489217211 time 7.52333 [07/23/2021-23:51:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:51:19] [V] [TRT] Tactic: -6055152894973171263 time 6.54349 [07/23/2021-23:51:19] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:51:20] [V] [TRT] Tactic: -5634849406670564996 time 16.078 [07/23/2021-23:51:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:20] [V] [TRT] Tactic: -5530886555766748586 time 5.9657 [07/23/2021-23:51:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:51:20] [V] [TRT] Tactic: -5421613452990385135 time 6.43584 [07/23/2021-23:51:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:51:20] [V] [TRT] Tactic: -5161596964442251102 time 7.23674 [07/23/2021-23:51:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:51:20] [V] [TRT] Tactic: -5127240325355316006 time 7.00902 [07/23/2021-23:51:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:51:20] [V] [TRT] Tactic: -4796511246675321840 time 7.75886 [07/23/2021-23:51:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:51:20] [V] [TRT] Tactic: -4706569565442112734 time 10.5379 [07/23/2021-23:51:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:51:20] [V] [TRT] Tactic: -4409144516525410768 time 5.97466 [07/23/2021-23:51:20] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:51:21] [V] [TRT] Tactic: -4379519430184503304 time 7.09786 [07/23/2021-23:51:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:51:21] [V] [TRT] Tactic: -4342782565153442362 time 6.44994 [07/23/2021-23:51:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:51:21] [V] [TRT] Tactic: -4191836638128696671 time 7.63648 [07/23/2021-23:51:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:21] [V] [TRT] Tactic: -4152066959007262150 time 5.53832 [07/23/2021-23:51:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:51:21] [V] [TRT] Tactic: -4021926646879732549 time 7.19898 [07/23/2021-23:51:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:51:21] [V] [TRT] Tactic: -3987638434926559037 time 7.71789 [07/23/2021-23:51:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:51:21] [V] [TRT] Tactic: -3939749857557624176 time 8.05299 [07/23/2021-23:51:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:21] [V] [TRT] Tactic: -3905653247016903130 time 6.63667 [07/23/2021-23:51:21] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:51:22] [V] [TRT] Tactic: -3895429239811098010 time 7.03462 [07/23/2021-23:51:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:22] [V] [TRT] Tactic: -3864869056275745423 time 7.2864 [07/23/2021-23:51:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:51:22] [V] [TRT] Tactic: -3601464762214218301 time 9.07494 [07/23/2021-23:51:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:22] [V] [TRT] Tactic: -3412636942650049698 time 6.71962 [07/23/2021-23:51:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:51:22] [V] [TRT] Tactic: -3058330359340425555 time 7.30765 [07/23/2021-23:51:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:51:22] [V] [TRT] Tactic: -2893013346565417259 time 6.83789 [07/23/2021-23:51:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:22] [V] [TRT] Tactic: -2816084650627734155 time 7.47905 [07/23/2021-23:51:22] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:23] [V] [TRT] Tactic: -2559894581585337900 time 6.35405 [07/23/2021-23:51:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:23] [V] [TRT] Tactic: -2241736083352441442 time 5.68166 [07/23/2021-23:51:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:23] [V] [TRT] Tactic: -1985778916402815946 time 7.50707 [07/23/2021-23:51:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:51:23] [V] [TRT] Tactic: -1979709471637578040 time 7.4391 [07/23/2021-23:51:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:51:23] [V] [TRT] Tactic: -1824906597022852312 time 6.41677 [07/23/2021-23:51:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:51:23] [V] [TRT] Tactic: -1727693334586194183 time 6.67635 [07/23/2021-23:51:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:51:23] [V] [TRT] Tactic: -1657270965825641606 time 6.09766 [07/23/2021-23:51:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:51:23] [V] [TRT] Tactic: -1500496213132463076 time 7.70445 [07/23/2021-23:51:23] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:51:24] [V] [TRT] Tactic: -1194193093145321861 time 10.0831 [07/23/2021-23:51:24] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:51:24] [V] [TRT] Tactic: -1099247066487349374 time 9.36282 [07/23/2021-23:51:24] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:51:24] [V] [TRT] Tactic: -705524612929044822 time 6.55386 [07/23/2021-23:51:24] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:51:24] [V] [TRT] Tactic: -680956411637736772 time 8.11328 [07/23/2021-23:51:24] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:51:24] [V] [TRT] Tactic: -504245585588397229 time 9.99949 [07/23/2021-23:51:24] [V] [TRT] Fastest Tactic: 3704534001553878387 Time: 5.24083 [07/23/2021-23:51:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CudaConvolution) [07/23/2021-23:51:25] [V] [TRT] Tactic: 0 time 62.3571 [07/23/2021-23:51:35] [V] [TRT] Tactic: 1 time 631.625 [07/23/2021-23:51:37] [V] [TRT] Tactic: 2 time 103.807 [07/23/2021-23:51:38] [V] [TRT] Tactic: 6 time 37.4675 [07/23/2021-23:51:39] [V] [TRT] Tactic: 56 time 62.5842 [07/23/2021-23:51:40] [V] [TRT] Tactic: 58 time 103.597 [07/23/2021-23:51:41] [V] [TRT] Tactic: 62 time 37.2854 [07/23/2021-23:51:41] [V] [TRT] Fastest Tactic: 62 Time: 37.2854 [07/23/2021-23:51:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CudaDepthwiseConvolution) [07/23/2021-23:51:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:51:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (CublasConvolution) [07/23/2021-23:51:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:51:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3704534001553878387 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:51:41] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:51:41] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:51:41] [V] [TRT] Tactic: 1002 time 8.07744 [07/23/2021-23:51:42] [V] [TRT] Tactic: 0 time 34.1228 [07/23/2021-23:51:42] [V] [TRT] Fastest Tactic: 1002 Time: 8.07744 [07/23/2021-23:51:42] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:51:42] [V] [TRT] Tactic: 1002 time 8.49523 [07/23/2021-23:51:43] [V] [TRT] Tactic: 0 time 34.1448 [07/23/2021-23:51:43] [V] [TRT] Fastest Tactic: 1002 Time: 8.49523 [07/23/2021-23:51:43] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:51:43] [V] [TRT] Tactic: 1002 time 8.29146 [07/23/2021-23:51:45] [V] [TRT] Tactic: 0 time 99.5725 [07/23/2021-23:51:45] [V] [TRT] Fastest Tactic: 1002 Time: 8.29146 [07/23/2021-23:51:45] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:51:45] [V] [TRT] Tactic: 1002 time 6.4544 [07/23/2021-23:51:45] [V] [TRT] Tactic: 0 time 7.17146 [07/23/2021-23:51:45] [V] [TRT] Fastest Tactic: 1002 Time: 6.4544 [07/23/2021-23:51:45] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:51:46] [V] [TRT] Tactic: 1002 time 20.4148 [07/23/2021-23:51:46] [V] [TRT] Tactic: 0 time 5.28128 [07/23/2021-23:51:46] [V] [TRT] Fastest Tactic: 0 Time: 5.28128 [07/23/2021-23:51:46] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:51:46] [V] [TRT] Tactic: 1002 time 7.00186 [07/23/2021-23:51:46] [V] [TRT] Tactic: 0 time 5.51744 [07/23/2021-23:51:46] [V] [TRT] Fastest Tactic: 0 Time: 5.51744 [07/23/2021-23:51:46] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:51:46] [V] [TRT] Tactic: 1002 time 8.016 [07/23/2021-23:51:47] [V] [TRT] Tactic: 0 time 69.6216 [07/23/2021-23:51:47] [V] [TRT] Fastest Tactic: 1002 Time: 8.016 [07/23/2021-23:51:48] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:51:48] [V] [TRT] Tactic: 1002 time 9.99642 [07/23/2021-23:51:48] [V] [TRT] Tactic: 0 time 7.12256 [07/23/2021-23:51:48] [V] [TRT] Fastest Tactic: 0 Time: 7.12256 [07/23/2021-23:51:48] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:51:48] [V] [TRT] Tactic: 1002 time 12.2149 [07/23/2021-23:51:51] [V] [TRT] Tactic: 0 time 163.083 [07/23/2021-23:51:51] [V] [TRT] Fastest Tactic: 1002 Time: 12.2149 [07/23/2021-23:51:51] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:51:51] [V] [TRT] Tactic: 1002 time 6.49216 [07/23/2021-23:51:52] [V] [TRT] Tactic: 0 time 68.0248 [07/23/2021-23:51:52] [V] [TRT] Fastest Tactic: 1002 Time: 6.49216 [07/23/2021-23:51:52] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:51:53] [V] [TRT] Tactic: 1002 time 17.856 [07/23/2021-23:51:54] [V] [TRT] Tactic: 0 time 72.4443 [07/23/2021-23:51:54] [V] [TRT] Fastest Tactic: 1002 Time: 17.856 [07/23/2021-23:51:54] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:51:54] [V] [TRT] Tactic: 1002 time 9.54368 [07/23/2021-23:51:54] [V] [TRT] Tactic: 0 time 5.16403 [07/23/2021-23:51:54] [V] [TRT] Fastest Tactic: 0 Time: 5.16403 [07/23/2021-23:51:55] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:51:55] [V] [TRT] Tactic: 1002 time 8.32448 [07/23/2021-23:51:56] [V] [TRT] Tactic: 0 time 69.9933 [07/23/2021-23:51:56] [V] [TRT] Fastest Tactic: 1002 Time: 8.32448 [07/23/2021-23:51:56] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:51:56] [V] [TRT] Tactic: 1002 time 9.99309 [07/23/2021-23:51:56] [V] [TRT] Tactic: 0 time 7.12947 [07/23/2021-23:51:56] [V] [TRT] Fastest Tactic: 0 Time: 7.12947 [07/23/2021-23:51:56] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:51:57] [V] [TRT] Tactic: 1002 time 12.2109 [07/23/2021-23:51:59] [V] [TRT] Tactic: 0 time 163.086 [07/23/2021-23:51:59] [V] [TRT] Fastest Tactic: 1002 Time: 12.2109 [07/23/2021-23:51:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:00] [V] [TRT] Tactic: 1002 time 7.19962 [07/23/2021-23:52:01] [V] [TRT] Tactic: 0 time 68.295 [07/23/2021-23:52:01] [V] [TRT] Fastest Tactic: 1002 Time: 7.19962 [07/23/2021-23:52:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:01] [V] [TRT] Tactic: 1002 time 17.8922 [07/23/2021-23:52:02] [V] [TRT] Tactic: 0 time 72.4662 [07/23/2021-23:52:02] [V] [TRT] Fastest Tactic: 1002 Time: 17.8922 [07/23/2021-23:52:03] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:03] [V] [TRT] Tactic: 1002 time 9.5648 [07/23/2021-23:52:03] [V] [TRT] Tactic: 0 time 5.34195 [07/23/2021-23:52:03] [V] [TRT] Fastest Tactic: 0 Time: 5.34195 [07/23/2021-23:52:03] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:04] [V] [TRT] Tactic: 1002 time 32.6719 [07/23/2021-23:52:04] [V] [TRT] Tactic: 0 time 38.6125 [07/23/2021-23:52:04] [V] [TRT] Fastest Tactic: 1002 Time: 32.6719 [07/23/2021-23:52:04] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:05] [V] [TRT] Tactic: 1002 time 9.15584 [07/23/2021-23:52:05] [V] [TRT] Tactic: 0 time 7.25543 [07/23/2021-23:52:05] [V] [TRT] Fastest Tactic: 0 Time: 7.25543 [07/23/2021-23:52:05] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:05] [V] [TRT] Tactic: 1002 time 9.15917 [07/23/2021-23:52:05] [V] [TRT] Tactic: 0 time 7.23187 [07/23/2021-23:52:05] [V] [TRT] Fastest Tactic: 0 Time: 7.23187 [07/23/2021-23:52:05] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:06] [V] [TRT] Tactic: 1002 time 34.2104 [07/23/2021-23:52:07] [V] [TRT] Tactic: 0 time 36.9871 [07/23/2021-23:52:07] [V] [TRT] Fastest Tactic: 1002 Time: 34.2104 [07/23/2021-23:52:07] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:07] [V] [TRT] Tactic: 1002 time 18.5821 [07/23/2021-23:52:08] [V] [TRT] Tactic: 0 time 42.404 [07/23/2021-23:52:08] [V] [TRT] Fastest Tactic: 1002 Time: 18.5821 [07/23/2021-23:52:08] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:08] [V] [TRT] Tactic: 1002 time 7.65427 [07/23/2021-23:52:08] [V] [TRT] Tactic: 0 time 5.65402 [07/23/2021-23:52:08] [V] [TRT] Fastest Tactic: 0 Time: 5.65402 [07/23/2021-23:52:08] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:08] [V] [TRT] Tactic: 1002 time 6.64256 [07/23/2021-23:52:08] [V] [TRT] Tactic: 0 time 8.55616 [07/23/2021-23:52:08] [V] [TRT] Fastest Tactic: 1002 Time: 6.64256 [07/23/2021-23:52:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:09] [V] [TRT] Tactic: 1002 time 6.59302 [07/23/2021-23:52:09] [V] [TRT] Tactic: 0 time 30.4471 [07/23/2021-23:52:09] [V] [TRT] Fastest Tactic: 1002 Time: 6.59302 [07/23/2021-23:52:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:10] [V] [TRT] Tactic: 1002 time 7.56736 [07/23/2021-23:52:10] [V] [TRT] Tactic: 0 time 30.4564 [07/23/2021-23:52:10] [V] [TRT] Fastest Tactic: 1002 Time: 7.56736 [07/23/2021-23:52:10] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:10] [V] [TRT] Tactic: 1002 time 7.31315 [07/23/2021-23:52:12] [V] [TRT] Tactic: 0 time 98.629 [07/23/2021-23:52:12] [V] [TRT] Fastest Tactic: 1002 Time: 7.31315 [07/23/2021-23:52:12] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:12] [V] [TRT] Tactic: 1002 time 20.0983 [07/23/2021-23:52:13] [V] [TRT] Tactic: 0 time 3.71814 [07/23/2021-23:52:13] [V] [TRT] Fastest Tactic: 0 Time: 3.71814 [07/23/2021-23:52:13] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:13] [V] [TRT] Tactic: 1002 time 6.79258 [07/23/2021-23:52:13] [V] [TRT] Tactic: 0 time 3.88471 [07/23/2021-23:52:13] [V] [TRT] Fastest Tactic: 0 Time: 3.88471 [07/23/2021-23:52:13] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:13] [V] [TRT] Tactic: 1002 time 11.3833 [07/23/2021-23:52:13] [V] [TRT] Tactic: 0 time 5.60936 [07/23/2021-23:52:13] [V] [TRT] Fastest Tactic: 0 Time: 5.60936 [07/23/2021-23:52:13] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:14] [V] [TRT] Tactic: 1002 time 7.01901 [07/23/2021-23:52:14] [V] [TRT] Tactic: 0 time 17.0372 [07/23/2021-23:52:14] [V] [TRT] Fastest Tactic: 1002 Time: 7.01901 [07/23/2021-23:52:14] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:14] [V] [TRT] Tactic: 1002 time 7.00544 [07/23/2021-23:52:14] [V] [TRT] Tactic: 0 time 17.1127 [07/23/2021-23:52:14] [V] [TRT] Fastest Tactic: 1002 Time: 7.00544 [07/23/2021-23:52:15] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:15] [V] [TRT] Tactic: 1002 time 6.79936 [07/23/2021-23:52:16] [V] [TRT] Tactic: 0 time 99.1855 [07/23/2021-23:52:16] [V] [TRT] Fastest Tactic: 1002 Time: 6.79936 [07/23/2021-23:52:16] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:17] [V] [TRT] Tactic: 1002 time 11.1432 [07/23/2021-23:52:17] [V] [TRT] Tactic: 0 time 3.42861 [07/23/2021-23:52:17] [V] [TRT] Fastest Tactic: 0 Time: 3.42861 [07/23/2021-23:52:17] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:17] [V] [TRT] Tactic: 1002 time 6.5344 [07/23/2021-23:52:17] [V] [TRT] Tactic: 0 time 3.9561 [07/23/2021-23:52:17] [V] [TRT] Fastest Tactic: 0 Time: 3.9561 [07/23/2021-23:52:17] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:17] [V] [TRT] Tactic: 1002 time 7.23674 [07/23/2021-23:52:17] [V] [TRT] Tactic: 0 time 5.66362 [07/23/2021-23:52:17] [V] [TRT] Fastest Tactic: 0 Time: 5.66362 [07/23/2021-23:52:17] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:18] [V] [TRT] Tactic: 1002 time 10.2639 [07/23/2021-23:52:18] [V] [TRT] Tactic: 0 time 5.37101 [07/23/2021-23:52:18] [V] [TRT] Fastest Tactic: 0 Time: 5.37101 [07/23/2021-23:52:18] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:18] [V] [TRT] Tactic: 1002 time 10.2524 [07/23/2021-23:52:18] [V] [TRT] Tactic: 0 time 5.52627 [07/23/2021-23:52:18] [V] [TRT] Fastest Tactic: 0 Time: 5.52627 [07/23/2021-23:52:18] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:19] [V] [TRT] Tactic: 1002 time 7.25952 [07/23/2021-23:52:21] [V] [TRT] Tactic: 0 time 130.67 [07/23/2021-23:52:21] [V] [TRT] Fastest Tactic: 1002 Time: 7.25952 [07/23/2021-23:52:21] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:21] [V] [TRT] Tactic: 1002 time 6.71373 [07/23/2021-23:52:21] [V] [TRT] Tactic: 0 time 3.75475 [07/23/2021-23:52:21] [V] [TRT] Fastest Tactic: 0 Time: 3.75475 [07/23/2021-23:52:21] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:21] [V] [TRT] Tactic: 1002 time 18.9862 [07/23/2021-23:52:22] [V] [TRT] Tactic: 0 time 3.75334 [07/23/2021-23:52:22] [V] [TRT] Fastest Tactic: 0 Time: 3.75334 [07/23/2021-23:52:22] [V] [TRT] *************** Autotuning format combination: Float(1,512,262144,67108864) -> Float(1,2,1024,2048,1048576,67108864) *************** [07/23/2021-23:52:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/lambda_1/DepthToSpace (Shuffle) [07/23/2021-23:52:22] [V] [TRT] Tactic: 0 time 7.16416 [07/23/2021-23:52:23] [V] [TRT] Tactic: 1 time 65.1917 [07/23/2021-23:52:23] [V] [TRT] Fastest Tactic: 0 Time: 7.16416 [07/23/2021-23:52:23] [V] [TRT] *************** Autotuning format combination: Float(256,131072,1,67108864) -> Float(2,4,1,2048,1048576,67108864) *************** [07/23/2021-23:52:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/lambda_1/DepthToSpace (Shuffle) [07/23/2021-23:52:24] [V] [TRT] Tactic: 0 time 51.8621 [07/23/2021-23:52:25] [V] [TRT] Tactic: 1 time 59.3791 [07/23/2021-23:52:25] [V] [TRT] Fastest Tactic: 0 Time: 51.8621 [07/23/2021-23:52:25] [V] [TRT] *************** Autotuning format combination: Float(64,32768,1:4,16777216) -> Float(1,2,1:4,1024,524288,33554432) *************** [07/23/2021-23:52:25] [07/23/2021-23:52:25] [07/23/2021-23:52:25] [V] [TRT] *************** Autotuning format combination: Float(1,512,262144:32,2097152) -> Float(1,2,1024:32,1024,524288,33554432) *************** [07/23/2021-23:52:25] [07/23/2021-23:52:25] [07/23/2021-23:52:25] [V] [TRT] *************** Autotuning format combination: Half(1,512,262144,67108864) -> Half(1,2,1024,2048,1048576,67108864) *************** [07/23/2021-23:52:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/lambda_1/DepthToSpace (Shuffle) [07/23/2021-23:52:25] [V] [TRT] Tactic: 0 time 4.96653 [07/23/2021-23:52:26] [V] [TRT] Tactic: 1 time 63.568 [07/23/2021-23:52:26] [V] [TRT] Fastest Tactic: 0 Time: 4.96653 [07/23/2021-23:52:26] [V] [TRT] *************** Autotuning format combination: Half(1,512,262144:2,33554432) -> Half(1,2,1024:2,1024,524288,33554432) *************** [07/23/2021-23:52:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/lambda_1/DepthToSpace (Shuffle) [07/23/2021-23:52:27] [V] [TRT] Tactic: 0 time 6.94835 [07/23/2021-23:52:29] [V] [TRT] Tactic: 1 time 131.15 [07/23/2021-23:52:29] [V] [TRT] Fastest Tactic: 0 Time: 6.94835 [07/23/2021-23:52:29] [V] [TRT] *************** Autotuning format combination: Half(32,16384,1:8,8388608) -> Half(1,2,1:8,1024,524288,33554432) *************** [07/23/2021-23:52:29] [07/23/2021-23:52:29] [07/23/2021-23:52:29] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:29] [V] [TRT] Tactic: 1002 time 41.9671 [07/23/2021-23:52:30] [V] [TRT] Tactic: 0 time 7.13344 [07/23/2021-23:52:30] [V] [TRT] Fastest Tactic: 0 Time: 7.13344 [07/23/2021-23:52:30] [07/23/2021-23:52:30] [07/23/2021-23:52:30] [07/23/2021-23:52:30] [07/23/2021-23:52:30] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:30] [V] [TRT] Tactic: 1002 time 6.4535 [07/23/2021-23:52:30] [V] [TRT] Tactic: 0 time 7.1753 [07/23/2021-23:52:30] [V] [TRT] Fastest Tactic: 1002 Time: 6.4535 [07/23/2021-23:52:30] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:32] [V] [TRT] Tactic: 1002 time 82.2433 [07/23/2021-23:52:32] [V] [TRT] Tactic: 0 time 5.20333 [07/23/2021-23:52:32] [V] [TRT] Fastest Tactic: 0 Time: 5.20333 [07/23/2021-23:52:32] [07/23/2021-23:52:32] [07/23/2021-23:52:32] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:33] [V] [TRT] Tactic: 1002 time 43.8698 [07/23/2021-23:52:33] [V] [TRT] Tactic: 0 time 7.088 [07/23/2021-23:52:33] [V] [TRT] Fastest Tactic: 0 Time: 7.088 [07/23/2021-23:52:33] [07/23/2021-23:52:33] [07/23/2021-23:52:33] [07/23/2021-23:52:33] [07/23/2021-23:52:33] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:34] [V] [TRT] Tactic: 1002 time 43.9884 [07/23/2021-23:52:34] [V] [TRT] Tactic: 0 time 5.08288 [07/23/2021-23:52:34] [V] [TRT] Fastest Tactic: 0 Time: 5.08288 [07/23/2021-23:52:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:35] [V] [TRT] Tactic: 1002 time 57.9082 [07/23/2021-23:52:35] [V] [TRT] Tactic: 0 time 5.14368 [07/23/2021-23:52:35] [V] [TRT] Fastest Tactic: 0 Time: 5.14368 [07/23/2021-23:52:35] [07/23/2021-23:52:35] [07/23/2021-23:52:35] [07/23/2021-23:52:35] [07/23/2021-23:52:35] [07/23/2021-23:52:35] [07/23/2021-23:52:36] [07/23/2021-23:52:36] [07/23/2021-23:52:36] [07/23/2021-23:52:36] [07/23/2021-23:52:36] [07/23/2021-23:52:36] [07/23/2021-23:52:36] [07/23/2021-23:52:36] [07/23/2021-23:52:36] [07/23/2021-23:52:36] [07/23/2021-23:52:36] [07/23/2021-23:52:36] [07/23/2021-23:52:36] [07/23/2021-23:52:36] [07/23/2021-23:52:36] [07/23/2021-23:52:36] [07/23/2021-23:52:36] [07/23/2021-23:52:36] [07/23/2021-23:52:36] [07/23/2021-23:52:36] [07/23/2021-23:52:36] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:36] [V] [TRT] Tactic: 1002 time 6.63846 [07/23/2021-23:52:36] [V] [TRT] Tactic: 0 time 8.55526 [07/23/2021-23:52:36] [V] [TRT] Fastest Tactic: 1002 Time: 6.63846 [07/23/2021-23:52:36] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:37] [V] [TRT] Tactic: 1002 time 42.0536 [07/23/2021-23:52:37] [V] [TRT] Tactic: 0 time 5.40506 [07/23/2021-23:52:37] [V] [TRT] Fastest Tactic: 0 Time: 5.40506 [07/23/2021-23:52:37] [07/23/2021-23:52:37] [07/23/2021-23:52:37] [07/23/2021-23:52:37] [07/23/2021-23:52:37] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:39] [V] [TRT] Tactic: 1002 time 82.2924 [07/23/2021-23:52:39] [V] [TRT] Tactic: 0 time 3.66528 [07/23/2021-23:52:39] [V] [TRT] Fastest Tactic: 0 Time: 3.66528 [07/23/2021-23:52:39] [07/23/2021-23:52:39] [07/23/2021-23:52:39] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:39] [V] [TRT] Tactic: 1002 time 11.0431 [07/23/2021-23:52:39] [V] [TRT] Tactic: 0 time 5.32749 [07/23/2021-23:52:39] [V] [TRT] Fastest Tactic: 0 Time: 5.32749 [07/23/2021-23:52:39] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:40] [V] [TRT] Tactic: 1002 time 57.4996 [07/23/2021-23:52:41] [V] [TRT] Tactic: 0 time 5.38675 [07/23/2021-23:52:41] [V] [TRT] Fastest Tactic: 0 Time: 5.38675 [07/23/2021-23:52:41] [07/23/2021-23:52:41] [07/23/2021-23:52:41] [07/23/2021-23:52:41] [07/23/2021-23:52:41] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:41] [V] [TRT] Tactic: 1002 time 10.854 [07/23/2021-23:52:41] [V] [TRT] Tactic: 0 time 3.63341 [07/23/2021-23:52:41] [V] [TRT] Fastest Tactic: 0 Time: 3.63341 [07/23/2021-23:52:41] [07/23/2021-23:52:41] [07/23/2021-23:52:41] [07/23/2021-23:52:41] [07/23/2021-23:52:41] [07/23/2021-23:52:41] [07/23/2021-23:52:41] [07/23/2021-23:52:41] [07/23/2021-23:52:41] [07/23/2021-23:52:41] [07/23/2021-23:52:42] [07/23/2021-23:52:42] [07/23/2021-23:52:42] [07/23/2021-23:52:42] [07/23/2021-23:52:42] [V] [TRT] *************** Autotuning format combination: Float(1,2,1024,2048,1048576,67108864) -> Float(1,1024,1048576,67108864) *************** [07/23/2021-23:52:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 286) [Shuffle] (Shuffle) [07/23/2021-23:52:42] [V] [TRT] Tactic: 0 time 7.19027 [07/23/2021-23:52:42] [V] [TRT] Tactic: 1 time 16.3429 [07/23/2021-23:52:42] [V] [TRT] Fastest Tactic: 0 Time: 7.19027 [07/23/2021-23:52:42] [V] [TRT] *************** Autotuning format combination: Float(2,4,1,2048,1048576,67108864) -> Float(64,65536,1,67108864) *************** [07/23/2021-23:52:42] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 286) [Shuffle] (Shuffle) [07/23/2021-23:52:43] [V] [TRT] Tactic: 0 time 29.3852 [07/23/2021-23:52:44] [V] [TRT] Tactic: 1 time 51.4801 [07/23/2021-23:52:44] [V] [TRT] Fastest Tactic: 0 Time: 29.3852 [07/23/2021-23:52:44] [V] [TRT] *************** Autotuning format combination: Float(1,2,1:4,1024,524288,33554432) -> Float(16,16384,1:4,16777216) *************** [07/23/2021-23:52:44] [07/23/2021-23:52:44] [07/23/2021-23:52:44] [V] [TRT] *************** Autotuning format combination: Float(1,2,1024:32,1024,524288,33554432) -> Float(1,1024,1048576:32,2097152) *************** [07/23/2021-23:52:44] [07/23/2021-23:52:44] [07/23/2021-23:52:44] [V] [TRT] *************** Autotuning format combination: Half(1,2,1024,2048,1048576,67108864) -> Half(1,1024,1048576,67108864) *************** [07/23/2021-23:52:44] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 286) [Shuffle] (Shuffle) [07/23/2021-23:52:44] [V] [TRT] Tactic: 0 time 3.59693 [07/23/2021-23:52:44] [V] [TRT] Tactic: 1 time 10.4458 [07/23/2021-23:52:44] [V] [TRT] Fastest Tactic: 0 Time: 3.59693 [07/23/2021-23:52:44] [V] [TRT] *************** Autotuning format combination: Half(1,2,1024:2,1024,524288,33554432) -> Half(1,1024,1048576:2,33554432) *************** [07/23/2021-23:52:44] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 286) [Shuffle] (Shuffle) [07/23/2021-23:52:45] [V] [TRT] Tactic: 0 time 8.41946 [07/23/2021-23:52:45] [V] [TRT] Tactic: 1 time 32.6935 [07/23/2021-23:52:45] [V] [TRT] Fastest Tactic: 0 Time: 8.41946 [07/23/2021-23:52:45] [V] [TRT] *************** Autotuning format combination: Half(1,2,1:8,1024,524288,33554432) -> Half(8,8192,1:8,8388608) *************** [07/23/2021-23:52:45] [07/23/2021-23:52:45] [07/23/2021-23:52:45] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:46] [V] [TRT] Tactic: 1002 time 7.94534 [07/23/2021-23:52:46] [V] [TRT] Tactic: 0 time 17.5323 [07/23/2021-23:52:46] [V] [TRT] Fastest Tactic: 1002 Time: 7.94534 [07/23/2021-23:52:46] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:46] [V] [TRT] Tactic: 1002 time 8.17242 [07/23/2021-23:52:47] [V] [TRT] Tactic: 0 time 17.3535 [07/23/2021-23:52:47] [V] [TRT] Fastest Tactic: 1002 Time: 8.17242 [07/23/2021-23:52:47] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:47] [V] [TRT] Tactic: 1002 time 6.45222 [07/23/2021-23:52:47] [V] [TRT] Tactic: 0 time 7.18016 [07/23/2021-23:52:47] [V] [TRT] Fastest Tactic: 1002 Time: 6.45222 [07/23/2021-23:52:47] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:47] [V] [TRT] Tactic: 1002 time 20.5324 [07/23/2021-23:52:48] [V] [TRT] Tactic: 0 time 5.28282 [07/23/2021-23:52:48] [V] [TRT] Fastest Tactic: 0 Time: 5.28282 [07/23/2021-23:52:48] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:48] [V] [TRT] Tactic: 1002 time 6.88934 [07/23/2021-23:52:48] [V] [TRT] Tactic: 0 time 5.39456 [07/23/2021-23:52:48] [V] [TRT] Fastest Tactic: 0 Time: 5.39456 [07/23/2021-23:52:48] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:48] [V] [TRT] Tactic: 1002 time 7.83565 [07/23/2021-23:52:49] [V] [TRT] Tactic: 0 time 44.6316 [07/23/2021-23:52:49] [V] [TRT] Fastest Tactic: 1002 Time: 7.83565 [07/23/2021-23:52:49] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:49] [V] [TRT] Tactic: 1002 time 21.1066 [07/23/2021-23:52:50] [V] [TRT] Tactic: 0 time 7.12307 [07/23/2021-23:52:50] [V] [TRT] Fastest Tactic: 0 Time: 7.12307 [07/23/2021-23:52:50] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:50] [V] [TRT] Tactic: 1002 time 6.3872 [07/23/2021-23:52:51] [V] [TRT] Tactic: 0 time 42.9199 [07/23/2021-23:52:51] [V] [TRT] Fastest Tactic: 1002 Time: 6.3872 [07/23/2021-23:52:51] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:51] [V] [TRT] Tactic: 1002 time 19.2141 [07/23/2021-23:52:52] [V] [TRT] Tactic: 0 time 49.3126 [07/23/2021-23:52:52] [V] [TRT] Fastest Tactic: 1002 Time: 19.2141 [07/23/2021-23:52:52] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:52] [V] [TRT] Tactic: 1002 time 20.97 [07/23/2021-23:52:53] [V] [TRT] Tactic: 0 time 5.16659 [07/23/2021-23:52:53] [V] [TRT] Fastest Tactic: 0 Time: 5.16659 [07/23/2021-23:52:53] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:53] [V] [TRT] Tactic: 1002 time 8.08435 [07/23/2021-23:52:54] [V] [TRT] Tactic: 0 time 44.6362 [07/23/2021-23:52:54] [V] [TRT] Fastest Tactic: 1002 Time: 8.08435 [07/23/2021-23:52:54] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:54] [V] [TRT] Tactic: 1002 time 21.1319 [07/23/2021-23:52:54] [V] [TRT] Tactic: 0 time 7.1191 [07/23/2021-23:52:54] [V] [TRT] Fastest Tactic: 0 Time: 7.1191 [07/23/2021-23:52:54] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:55] [V] [TRT] Tactic: 1002 time 7.0432 [07/23/2021-23:52:55] [V] [TRT] Tactic: 0 time 43.1436 [07/23/2021-23:52:55] [V] [TRT] Fastest Tactic: 1002 Time: 7.0432 [07/23/2021-23:52:55] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:56] [V] [TRT] Tactic: 1002 time 19.2009 [07/23/2021-23:52:57] [V] [TRT] Tactic: 0 time 49.487 [07/23/2021-23:52:57] [V] [TRT] Fastest Tactic: 1002 Time: 19.2009 [07/23/2021-23:52:57] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:57] [V] [TRT] Tactic: 1002 time 20.9252 [07/23/2021-23:52:57] [V] [TRT] Tactic: 0 time 5.34861 [07/23/2021-23:52:57] [V] [TRT] Fastest Tactic: 0 Time: 5.34861 [07/23/2021-23:52:57] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:58] [V] [TRT] Tactic: 1002 time 37.6147 [07/23/2021-23:52:59] [V] [TRT] Tactic: 0 time 38.6001 [07/23/2021-23:52:59] [V] [TRT] Fastest Tactic: 1002 Time: 37.6147 [07/23/2021-23:52:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:59] [V] [TRT] Tactic: 1002 time 8.93722 [07/23/2021-23:52:59] [V] [TRT] Tactic: 0 time 7.17133 [07/23/2021-23:52:59] [V] [TRT] Fastest Tactic: 0 Time: 7.17133 [07/23/2021-23:52:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:52:59] [V] [TRT] Tactic: 1002 time 8.96576 [07/23/2021-23:52:59] [V] [TRT] Tactic: 0 time 7.15878 [07/23/2021-23:52:59] [V] [TRT] Fastest Tactic: 0 Time: 7.15878 [07/23/2021-23:53:00] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:00] [V] [TRT] Tactic: 1002 time 36.0369 [07/23/2021-23:53:01] [V] [TRT] Tactic: 0 time 36.9939 [07/23/2021-23:53:01] [V] [TRT] Fastest Tactic: 1002 Time: 36.0369 [07/23/2021-23:53:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:01] [V] [TRT] Tactic: 1002 time 19.1299 [07/23/2021-23:53:02] [V] [TRT] Tactic: 0 time 42.3974 [07/23/2021-23:53:02] [V] [TRT] Fastest Tactic: 1002 Time: 19.1299 [07/23/2021-23:53:02] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:02] [V] [TRT] Tactic: 1002 time 7.39789 [07/23/2021-23:53:02] [V] [TRT] Tactic: 0 time 5.50579 [07/23/2021-23:53:02] [V] [TRT] Fastest Tactic: 0 Time: 5.50579 [07/23/2021-23:53:02] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:03] [V] [TRT] Tactic: 1002 time 6.64141 [07/23/2021-23:53:03] [V] [TRT] Tactic: 0 time 8.5531 [07/23/2021-23:53:03] [V] [TRT] Fastest Tactic: 1002 Time: 6.64141 [07/23/2021-23:53:03] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:03] [V] [TRT] Tactic: 1002 time 6.54554 [07/23/2021-23:53:03] [V] [TRT] Tactic: 0 time 15.1305 [07/23/2021-23:53:03] [V] [TRT] Fastest Tactic: 1002 Time: 6.54554 [07/23/2021-23:53:03] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:04] [V] [TRT] Tactic: 1002 time 7.37525 [07/23/2021-23:53:04] [V] [TRT] Tactic: 0 time 14.7953 [07/23/2021-23:53:04] [V] [TRT] Fastest Tactic: 1002 Time: 7.37525 [07/23/2021-23:53:04] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:04] [V] [TRT] Tactic: 1002 time 20.3558 [07/23/2021-23:53:04] [V] [TRT] Tactic: 0 time 3.69421 [07/23/2021-23:53:04] [V] [TRT] Fastest Tactic: 0 Time: 3.69421 [07/23/2021-23:53:05] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:05] [V] [TRT] Tactic: 1002 time 6.74842 [07/23/2021-23:53:05] [V] [TRT] Tactic: 0 time 3.80454 [07/23/2021-23:53:05] [V] [TRT] Fastest Tactic: 0 Time: 3.80454 [07/23/2021-23:53:05] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:05] [V] [TRT] Tactic: 1002 time 11.3585 [07/23/2021-23:53:05] [V] [TRT] Tactic: 0 time 7.14138 [07/23/2021-23:53:05] [V] [TRT] Fastest Tactic: 0 Time: 7.14138 [07/23/2021-23:53:05] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:06] [V] [TRT] Tactic: 1002 time 6.82368 [07/23/2021-23:53:06] [V] [TRT] Tactic: 0 time 7.25837 [07/23/2021-23:53:06] [V] [TRT] Fastest Tactic: 1002 Time: 6.82368 [07/23/2021-23:53:06] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:06] [V] [TRT] Tactic: 1002 time 6.84621 [07/23/2021-23:53:06] [V] [TRT] Tactic: 0 time 7.62944 [07/23/2021-23:53:06] [V] [TRT] Fastest Tactic: 1002 Time: 6.84621 [07/23/2021-23:53:06] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:06] [V] [TRT] Tactic: 1002 time 11.1642 [07/23/2021-23:53:07] [V] [TRT] Tactic: 0 time 5.15418 [07/23/2021-23:53:07] [V] [TRT] Fastest Tactic: 0 Time: 5.15418 [07/23/2021-23:53:07] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:07] [V] [TRT] Tactic: 1002 time 6.56794 [07/23/2021-23:53:07] [V] [TRT] Tactic: 0 time 3.85805 [07/23/2021-23:53:07] [V] [TRT] Fastest Tactic: 0 Time: 3.85805 [07/23/2021-23:53:07] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:07] [V] [TRT] Tactic: 1002 time 7.00186 [07/23/2021-23:53:07] [V] [TRT] Tactic: 0 time 5.49837 [07/23/2021-23:53:07] [V] [TRT] Fastest Tactic: 0 Time: 5.49837 [07/23/2021-23:53:07] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:08] [V] [TRT] Tactic: 1002 time 21.3275 [07/23/2021-23:53:08] [V] [TRT] Tactic: 0 time 5.37843 [07/23/2021-23:53:08] [V] [TRT] Fastest Tactic: 0 Time: 5.37843 [07/23/2021-23:53:08] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:08] [V] [TRT] Tactic: 1002 time 21.2192 [07/23/2021-23:53:08] [V] [TRT] Tactic: 0 time 5.54522 [07/23/2021-23:53:08] [V] [TRT] Fastest Tactic: 0 Time: 5.54522 [07/23/2021-23:53:08] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:09] [V] [TRT] Tactic: 1002 time 6.62528 [07/23/2021-23:53:09] [V] [TRT] Tactic: 0 time 3.61075 [07/23/2021-23:53:09] [V] [TRT] Fastest Tactic: 0 Time: 3.61075 [07/23/2021-23:53:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:09] [V] [TRT] Tactic: 1002 time 18.7747 [07/23/2021-23:53:09] [V] [TRT] Tactic: 0 time 3.57837 [07/23/2021-23:53:09] [V] [TRT] Fastest Tactic: 0 Time: 3.57837 [07/23/2021-23:53:09] [V] [TRT] *************** Autotuning format combination: Float(1,1024,1048576,67108864) -> Float(1,1024,1048576,3145728) *************** [07/23/2021-23:53:09] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 [07/23/2021-23:53:09] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 [07/23/2021-23:53:09] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 [07/23/2021-23:53:09] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 [07/23/2021-23:53:09] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 [07/23/2021-23:53:09] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 [07/23/2021-23:53:09] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 [07/23/2021-23:53:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (FusedConvActConvolution) [07/23/2021-23:53:09] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CaskConvolution) [07/23/2021-23:53:09] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 [07/23/2021-23:53:10] [V] [TRT] Tactic: 4549827808004681195 time 33.1814 [07/23/2021-23:53:10] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 [07/23/2021-23:53:11] [V] [TRT] Tactic: 5779835512569528575 time 59.9826 [07/23/2021-23:53:11] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 [07/23/2021-23:53:12] [V] [TRT] Tactic: 6053873026024413720 time 62.3891 [07/23/2021-23:53:12] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 [07/23/2021-23:53:12] [V] [TRT] Tactic: 6767548733843469815 time 32.2252 [07/23/2021-23:53:12] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 [07/23/2021-23:53:13] [V] [TRT] Tactic: -6313876406580483184 time 18.209 [07/23/2021-23:53:13] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 [07/23/2021-23:53:14] [V] [TRT] Tactic: -1123676555321336786 time 60.517 [07/23/2021-23:53:14] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 [07/23/2021-23:53:14] [V] [TRT] Tactic: -701551393537224327 time 33.6905 [07/23/2021-23:53:14] [V] [TRT] Fastest Tactic: -6313876406580483184 Time: 18.209 [07/23/2021-23:53:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CudaConvolution) [07/23/2021-23:53:15] [V] [TRT] Tactic: 0 time 30.9407 [07/23/2021-23:53:15] [V] [TRT] Tactic: 1 time 30.9228 [07/23/2021-23:53:16] [V] [TRT] Tactic: 2 time 30.9254 [07/23/2021-23:53:16] [V] [TRT] Tactic: 5 time 33.2483 [07/23/2021-23:53:17] [V] [TRT] Tactic: 6 time 15.3566 [07/23/2021-23:53:17] [V] [TRT] Tactic: 56 time 30.8516 [07/23/2021-23:53:18] [V] [TRT] Tactic: 57 time 31.0209 [07/23/2021-23:53:18] [V] [TRT] Tactic: 58 time 30.9339 [07/23/2021-23:53:19] [V] [TRT] Tactic: 61 time 33.1498 [07/23/2021-23:53:19] [V] [TRT] Tactic: 62 time 15.3521 [07/23/2021-23:53:19] [V] [TRT] Tactic: 112 time 30.8915 [07/23/2021-23:53:20] [V] [TRT] Tactic: 113 time 31.0319 [07/23/2021-23:53:20] [V] [TRT] Tactic: 114 time 30.9637 [07/23/2021-23:53:21] [V] [TRT] Tactic: 117 time 33.188 [07/23/2021-23:53:21] [V] [TRT] Tactic: 118 time 15.3537 [07/23/2021-23:53:21] [V] [TRT] Fastest Tactic: 62 Time: 15.3521 [07/23/2021-23:53:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CudaDepthwiseConvolution) [07/23/2021-23:53:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CublasConvolution) [07/23/2021-23:53:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 62 [07/23/2021-23:53:21] [V] [TRT] [07/23/2021-23:53:21] [V] [TRT] *************** Autotuning format combination: Float(64,65536,1,67108864) -> Float(3,3072,1,3145728) *************** [07/23/2021-23:53:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (FusedConvActConvolution) [07/23/2021-23:53:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CaskConvolution) [07/23/2021-23:53:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CudaConvolution) [07/23/2021-23:53:21] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CudaDepthwiseConvolution) [07/23/2021-23:53:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CublasConvolution) [07/23/2021-23:53:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:21] [V] [TRT] *************** Autotuning format combination: Float(16,16384,1:4,16777216) -> Float(1,1024,1:4,1048576) *************** [07/23/2021-23:53:21] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:21] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:21] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:21] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:21] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:21] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:21] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:21] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:21] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:21] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:21] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (FusedConvActConvolution) [07/23/2021-23:53:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CaskConvolution) [07/23/2021-23:53:21] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:22] [V] [TRT] Tactic: 2860655430572478466 time 32.6892 [07/23/2021-23:53:22] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:22] [V] [TRT] Tactic: 4474630279712975759 time 18.2208 [07/23/2021-23:53:22] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:23] [V] [TRT] Tactic: 4479823862704990365 time 18.0558 [07/23/2021-23:53:23] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:23] [V] [TRT] Tactic: 4696204239951173149 time 32.9619 [07/23/2021-23:53:23] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:24] [V] [TRT] Tactic: 5778138195697110003 time 60.2099 [07/23/2021-23:53:24] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:25] [V] [TRT] Tactic: 7155825427510256858 time 58.8607 [07/23/2021-23:53:25] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:26] [V] [TRT] Tactic: 8918020581761223752 time 58.5207 [07/23/2021-23:53:26] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:27] [V] [TRT] Tactic: -4756382386362004279 time 32.708 [07/23/2021-23:53:27] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:28] [V] [TRT] Tactic: -3855385237722507464 time 60.902 [07/23/2021-23:53:28] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:29] [V] [TRT] Tactic: -2809379259463049391 time 60.878 [07/23/2021-23:53:29] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:30] [V] [TRT] Tactic: -504296718212024303 time 58.5221 [07/23/2021-23:53:30] [V] [TRT] Fastest Tactic: 4479823862704990365 Time: 18.0558 [07/23/2021-23:53:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CudaConvolution) [07/23/2021-23:53:30] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CudaDepthwiseConvolution) [07/23/2021-23:53:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CublasConvolution) [07/23/2021-23:53:30] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4479823862704990365 [07/23/2021-23:53:30] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:30] [V] [TRT] [07/23/2021-23:53:30] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:30] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:30] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:30] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:30] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:30] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:30] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:30] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:30] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:30] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:30] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:30] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (scudnn) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:30] [V] [TRT] *************** Autotuning format combination: Half(1,1024,1048576,67108864) -> Half(1,1024,1048576,3145728) *************** [07/23/2021-23:53:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (FusedConvActConvolution) [07/23/2021-23:53:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CaskConvolution) [07/23/2021-23:53:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CudaConvolution) [07/23/2021-23:53:31] [V] [TRT] Tactic: 0 time 78.5611 [07/23/2021-23:53:31] [V] [TRT] Tactic: 1 time 18.5489 [07/23/2021-23:53:33] [V] [TRT] Tactic: 2 time 93.6301 [07/23/2021-23:53:33] [V] [TRT] Tactic: 5 time 31.2348 [07/23/2021-23:53:34] [V] [TRT] Tactic: 6 time 21.2014 [07/23/2021-23:53:35] [V] [TRT] Tactic: 56 time 78.9124 [07/23/2021-23:53:36] [V] [TRT] Tactic: 58 time 93.3619 [07/23/2021-23:53:37] [V] [TRT] Tactic: 61 time 31.2671 [07/23/2021-23:53:37] [V] [TRT] Tactic: 62 time 21.2011 [07/23/2021-23:53:37] [V] [TRT] Fastest Tactic: 1 Time: 18.5489 [07/23/2021-23:53:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CudaDepthwiseConvolution) [07/23/2021-23:53:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CublasConvolution) [07/23/2021-23:53:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [07/23/2021-23:53:37] [V] [TRT] [07/23/2021-23:53:37] [V] [TRT] *************** Autotuning format combination: Half(1,1024,1048576:2,33554432) -> Half(1,1024,1048576:2,2097152) *************** [07/23/2021-23:53:37] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:53:37] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:53:37] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:53:37] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:53:37] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:53:37] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:53:37] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:53:37] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:53:37] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:53:37] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:53:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (FusedConvActConvolution) [07/23/2021-23:53:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CaskConvolution) [07/23/2021-23:53:37] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:53:38] [V] [TRT] Tactic: 2195670545862694453 time 9.68563 [07/23/2021-23:53:38] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:53:38] [V] [TRT] Tactic: 3419182076704469245 time 18.479 [07/23/2021-23:53:38] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:53:38] [V] [TRT] Tactic: 3891805945559659536 time 36.9804 [07/23/2021-23:53:38] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:53:39] [V] [TRT] Tactic: 5548126322150286555 time 18.2678 [07/23/2021-23:53:39] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:53:39] [V] [TRT] Tactic: 6057304366605292508 time 18.1699 [07/23/2021-23:53:39] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:53:40] [V] [TRT] Tactic: -7928611605886347652 time 37.6709 [07/23/2021-23:53:40] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:53:40] [V] [TRT] Tactic: -5172391392092686714 time 9.62534 [07/23/2021-23:53:40] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:53:40] [V] [TRT] Tactic: -4374269919094467161 time 9.6256 [07/23/2021-23:53:40] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:53:40] [V] [TRT] Tactic: -4083394051665370953 time 7.49773 [07/23/2021-23:53:40] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:53:41] [V] [TRT] Tactic: -1546027692247304867 time 36.8815 [07/23/2021-23:53:41] [V] [TRT] Fastest Tactic: -4083394051665370953 Time: 7.49773 [07/23/2021-23:53:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CudaConvolution) [07/23/2021-23:53:41] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CudaDepthwiseConvolution) [07/23/2021-23:53:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CublasConvolution) [07/23/2021-23:53:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4083394051665370953 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:53:41] [V] [TRT] [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (hcudnn_winograd) Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/23/2021-23:53:41] [V] [TRT] *************** Autotuning format combination: Half(8,8192,1:8,8388608) -> Float(1,1024,1048576,3145728) *************** [07/23/2021-23:53:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (FusedConvActConvolution) [07/23/2021-23:53:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CaskConvolution) [07/23/2021-23:53:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CudaConvolution) [07/23/2021-23:53:41] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CudaDepthwiseConvolution) [07/23/2021-23:53:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CublasConvolution) [07/23/2021-23:53:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:41] [V] [TRT] *************** Autotuning format combination: Half(8,8192,1:8,8388608) -> Half(1,1024,1:8,1048576) *************** [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:53:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (FusedConvActConvolution) [07/23/2021-23:53:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CaskConvolution) [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] Tactic: 254850674756030979 time 10.597 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:41] [V] [TRT] Tactic: 1156328698016730421 time 10.133 [07/23/2021-23:53:41] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:53:42] [V] [TRT] Tactic: 1584305878200231339 time 11.2776 [07/23/2021-23:53:42] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:53:42] [V] [TRT] Tactic: 1832046141070096030 time 7.10259 [07/23/2021-23:53:42] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:53:42] [V] [TRT] Tactic: 1838082074606840426 time 7.0199 [07/23/2021-23:53:42] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:53:42] [V] [TRT] Tactic: 1899296423087490472 time 8.98509 [07/23/2021-23:53:42] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:53:42] [V] [TRT] Tactic: 2338136297163812551 time 11.1497 [07/23/2021-23:53:42] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:42] [V] [TRT] Tactic: 2541579301352125276 time 11.1974 [07/23/2021-23:53:42] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:53:42] [V] [TRT] Tactic: 2657157263811141609 time 9.30726 [07/23/2021-23:53:42] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:53:43] [V] [TRT] Tactic: 2819719497590964443 time 14.4084 [07/23/2021-23:53:43] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:53:43] [V] [TRT] Tactic: 2835786846016979545 time 7.54406 [07/23/2021-23:53:43] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:53:43] [V] [TRT] Tactic: 2968605903460894194 time 6.94221 [07/23/2021-23:53:43] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:43] [V] [TRT] Tactic: 2986078304285316765 time 11.169 [07/23/2021-23:53:43] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:53:43] [V] [TRT] Tactic: 3362537467505018070 time 11.3085 [07/23/2021-23:53:43] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:44] [V] [TRT] Tactic: 3513075359009385578 time 10.7382 [07/23/2021-23:53:44] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:53:44] [V] [TRT] Tactic: 3546424067684403057 time 6.27059 [07/23/2021-23:53:44] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:53:44] [V] [TRT] Tactic: 3573559043797674382 time 7.16326 [07/23/2021-23:53:44] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:44] [V] [TRT] Tactic: 3704534001553878387 time 9.62854 [07/23/2021-23:53:44] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:53:44] [V] [TRT] Tactic: 4278315135102886928 time 13.2708 [07/23/2021-23:53:44] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:53:44] [V] [TRT] Tactic: 4750655167565104065 time 6.46822 [07/23/2021-23:53:44] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:44] [V] [TRT] Tactic: 4802447371470387646 time 6.47936 [07/23/2021-23:53:44] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:45] [V] [TRT] Tactic: 5059676457552313631 time 10.3962 [07/23/2021-23:53:45] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:45] [V] [TRT] Tactic: 5398999388616959893 time 6.36915 [07/23/2021-23:53:45] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:53:45] [V] [TRT] Tactic: 5579149726397848560 time 5.7353 [07/23/2021-23:53:45] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:53:45] [V] [TRT] Tactic: 5746691132547383910 time 13.9771 [07/23/2021-23:53:45] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:45] [V] [TRT] Tactic: 5770170567977052602 time 6.6615 [07/23/2021-23:53:45] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:53:45] [V] [TRT] Tactic: 5896806418498994339 time 4.51713 [07/23/2021-23:53:45] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:53:46] [V] [TRT] Tactic: 6034364043891107501 time 12.9239 [07/23/2021-23:53:46] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:53:46] [V] [TRT] Tactic: 6074229447555668232 time 9.14868 [07/23/2021-23:53:46] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:53:46] [V] [TRT] Tactic: 6176524653920166422 time 6.04083 [07/23/2021-23:53:46] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:53:46] [V] [TRT] Tactic: 6272216432116166416 time 11.285 [07/23/2021-23:53:46] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:53:46] [V] [TRT] Tactic: 6377497238381488891 time 11.1963 [07/23/2021-23:53:46] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:53:46] [V] [TRT] Tactic: 6428823438254963239 time 7.69562 [07/23/2021-23:53:46] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:53:46] [V] [TRT] Tactic: 6446388116965632819 time 6.89408 [07/23/2021-23:53:46] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:53:47] [V] [TRT] Tactic: 6468794451065529747 time 7.18643 [07/23/2021-23:53:47] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:47] [V] [TRT] Tactic: 6642277870194067185 time 10.7169 [07/23/2021-23:53:47] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:53:47] [V] [TRT] Tactic: 6725284471687256210 time 4.60877 [07/23/2021-23:53:47] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:53:47] [V] [TRT] Tactic: 6859477213531075460 time 8.7168 [07/23/2021-23:53:47] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:53:47] [V] [TRT] Tactic: 7100752989500049598 time 4.64461 [07/23/2021-23:53:47] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:47] [V] [TRT] Tactic: 7216571380637776659 time 5.3129 [07/23/2021-23:53:47] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:53:47] [V] [TRT] Tactic: 7609923741161019135 time 6.85171 [07/23/2021-23:53:47] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:53:47] [V] [TRT] Tactic: 7667554089956651578 time 6.20902 [07/23/2021-23:53:47] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:53:48] [V] [TRT] Tactic: 7705739241028240201 time 9.47277 [07/23/2021-23:53:48] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:53:48] [V] [TRT] Tactic: 8040838497444300918 time 8.54451 [07/23/2021-23:53:48] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:53:48] [V] [TRT] Tactic: 8101703987960976805 time 9.60179 [07/23/2021-23:53:48] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:53:48] [V] [TRT] Tactic: 8170606396342855895 time 7.0208 [07/23/2021-23:53:48] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:53:48] [V] [TRT] Tactic: 8264928564315835356 time 5.69907 [07/23/2021-23:53:48] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:48] [V] [TRT] Tactic: 8839784824303350101 time 5.20435 [07/23/2021-23:53:48] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:53:49] [V] [TRT] Tactic: -9217371357561775773 time 9.91398 [07/23/2021-23:53:49] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:49] [V] [TRT] Tactic: -9009272790678027912 time 6.74138 [07/23/2021-23:53:49] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:53:49] [V] [TRT] Tactic: -8949544755481315679 time 7.32954 [07/23/2021-23:53:49] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:53:49] [V] [TRT] Tactic: -8604374562669615024 time 9.24224 [07/23/2021-23:53:49] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:53:49] [V] [TRT] Tactic: -7938306756270351617 time 20.1637 [07/23/2021-23:53:49] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:53:49] [V] [TRT] Tactic: -7027328628217650515 time 10.9774 [07/23/2021-23:53:49] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:53:50] [V] [TRT] Tactic: -6840588038605932325 time 13.5841 [07/23/2021-23:53:50] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:53:50] [V] [TRT] Tactic: -6603588435230240365 time 20.8808 [07/23/2021-23:53:50] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:53:50] [V] [TRT] Tactic: -6356316196810535311 time 9.8377 [07/23/2021-23:53:50] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:50] [V] [TRT] Tactic: -6257787336162086472 time 9.79815 [07/23/2021-23:53:50] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:53:50] [V] [TRT] Tactic: -6063766379489217211 time 6.90739 [07/23/2021-23:53:50] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:53:51] [V] [TRT] Tactic: -6055152894973171263 time 12.5294 [07/23/2021-23:53:51] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:53:51] [V] [TRT] Tactic: -5634849406670564996 time 6.44915 [07/23/2021-23:53:51] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:51] [V] [TRT] Tactic: -5530886555766748586 time 11.0883 [07/23/2021-23:53:51] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:53:51] [V] [TRT] Tactic: -5421613452990385135 time 10.2468 [07/23/2021-23:53:51] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:53:51] [V] [TRT] Tactic: -5161596964442251102 time 13.7873 [07/23/2021-23:53:51] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:53:52] [V] [TRT] Tactic: -5127240325355316006 time 12.9866 [07/23/2021-23:53:52] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:53:52] [V] [TRT] Tactic: -4796511246675321840 time 14.0955 [07/23/2021-23:53:52] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:53:52] [V] [TRT] Tactic: -4706569565442112734 time 10.0134 [07/23/2021-23:53:52] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:53:52] [V] [TRT] Tactic: -4409144516525410768 time 11.217 [07/23/2021-23:53:52] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:53:52] [V] [TRT] Tactic: -4379519430184503304 time 6.7757 [07/23/2021-23:53:52] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:53:53] [V] [TRT] Tactic: -4342782565153442362 time 10.1844 [07/23/2021-23:53:53] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:53:53] [V] [TRT] Tactic: -4191836638128696671 time 7.05818 [07/23/2021-23:53:53] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:53] [V] [TRT] Tactic: -4152066959007262150 time 10.6543 [07/23/2021-23:53:53] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:53:53] [V] [TRT] Tactic: -4021926646879732549 time 13.3983 [07/23/2021-23:53:53] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:53:53] [V] [TRT] Tactic: -3987638434926559037 time 14.2341 [07/23/2021-23:53:53] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:53:54] [V] [TRT] Tactic: -3939749857557624176 time 6.48026 [07/23/2021-23:53:54] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:54] [V] [TRT] Tactic: -3905653247016903130 time 6.46184 [07/23/2021-23:53:54] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:53:54] [V] [TRT] Tactic: -3895429239811098010 time 13.0985 [07/23/2021-23:53:54] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:54] [V] [TRT] Tactic: -3864869056275745423 time 6.38502 [07/23/2021-23:53:54] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:53:54] [V] [TRT] Tactic: -3601464762214218301 time 8.51251 [07/23/2021-23:53:54] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:54] [V] [TRT] Tactic: -3412636942650049698 time 6.4649 [07/23/2021-23:53:54] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:53:54] [V] [TRT] Tactic: -3058330359340425555 time 13.7472 [07/23/2021-23:53:54] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:53:55] [V] [TRT] Tactic: -2893013346565417259 time 12.5773 [07/23/2021-23:53:55] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:55] [V] [TRT] Tactic: -2816084650627734155 time 6.78042 [07/23/2021-23:53:55] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:55] [V] [TRT] Tactic: -2559894581585337900 time 10.2605 [07/23/2021-23:53:55] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:55] [V] [TRT] Tactic: -2241736083352441442 time 5.35168 [07/23/2021-23:53:55] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:55] [V] [TRT] Tactic: -1985778916402815946 time 6.80691 [07/23/2021-23:53:55] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:53:55] [V] [TRT] Tactic: -1979709471637578040 time 14.6047 [07/23/2021-23:53:55] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:53:56] [V] [TRT] Tactic: -1824906597022852312 time 20.5347 [07/23/2021-23:53:56] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:53:56] [V] [TRT] Tactic: -1727693334586194183 time 12.3731 [07/23/2021-23:53:56] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:53:56] [V] [TRT] Tactic: -1657270965825641606 time 11.4564 [07/23/2021-23:53:56] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:53:56] [V] [TRT] Tactic: -1500496213132463076 time 7.31136 [07/23/2021-23:53:56] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:53:57] [V] [TRT] Tactic: -1194193093145321861 time 8.06336 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] Tactic: -1099247066487349374 time 8.93619 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:53:57] [V] [TRT] Tactic: -705524612929044822 time 10.5537 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:53:57] [V] [TRT] Tactic: -680956411637736772 time 6.86707 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:53:57] [V] [TRT] Tactic: -504245585588397229 time 9.74029 [07/23/2021-23:53:57] [V] [TRT] Fastest Tactic: 5896806418498994339 Time: 4.51713 [07/23/2021-23:53:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CudaConvolution) [07/23/2021-23:53:57] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CudaDepthwiseConvolution) [07/23/2021-23:53:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd (CublasConvolution) [07/23/2021-23:53:57] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/23/2021-23:53:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5896806418498994339 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:53:57] [V] [TRT] [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x64x1_16x8x16_3stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x64x1_16x8x16_3stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x32x64x1_16x8x16_5stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x32x64x1_16x8x16_5stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x64x32x1_16x8x16_3stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x64x32x1_16x8x16_3stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x32x1_16x8x16_5stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x64x1_16x8x16_3stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x32x1_16x8x16_5stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x32x32x1_16x8x16_4stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x32x32x1_16x8x16_4stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x32x1_16x8x16_5stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x64x64x1_16x8x16_4stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x64x32x1_16x8x16_3stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x256x32x1_16x8x16_3stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x128x32x1_16x8x16_4stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x256x32x1_16x8x16_3stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x128x32x1_16x8x16_4stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x32x64x1_16x8x16_5stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_256x128x32x1_16x8x16_3stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_128x64x64x1_16x8x16_3stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_128x64x64x1_16x8x16_3stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_64x128x32x1_16x8x16_5stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x128x32x1_16x8x16_5stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x256x32x1_16x8x16_3stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x128x32x1_16x8x16_5stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x128x32x1_16x8x16_4stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_1x3x3_64x64x64x1_16x8x16_4stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x128x32x1_16x8x16_3stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_128x64x64x1_16x8x16_3stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_64x64x64x1_16x8x16_4stages [07/23/2021-23:53:57] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:53:57] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:57] [V] [TRT] Tactic: 1002 time 1.23149 [07/23/2021-23:53:57] [V] [TRT] Tactic: 0 time 0.342912 [07/23/2021-23:53:57] [V] [TRT] Fastest Tactic: 0 Time: 0.342912 [07/23/2021-23:53:57] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:57] [V] [TRT] Tactic: 1002 time 3.0743 [07/23/2021-23:53:57] [V] [TRT] Tactic: 0 time 1.15366 [07/23/2021-23:53:57] [V] [TRT] Fastest Tactic: 0 Time: 1.15366 [07/23/2021-23:53:57] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:58] [V] [TRT] Tactic: 1002 time 2.51686 [07/23/2021-23:53:58] [V] [TRT] Tactic: 0 time 47.9724 [07/23/2021-23:53:58] [V] [TRT] Fastest Tactic: 1002 Time: 2.51686 [07/23/2021-23:53:58] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:58] [V] [TRT] Tactic: 1002 time 0.292352 [07/23/2021-23:53:58] [V] [TRT] Tactic: 0 time 0.348288 [07/23/2021-23:53:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.292352 [07/23/2021-23:53:58] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:59] [V] [TRT] Tactic: 1002 time 2.52301 [07/23/2021-23:53:59] [V] [TRT] Tactic: 0 time 0.276864 [07/23/2021-23:53:59] [V] [TRT] Fastest Tactic: 0 Time: 0.276864 [07/23/2021-23:53:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:59] [V] [TRT] Tactic: 1002 time 3.1168 [07/23/2021-23:53:59] [V] [TRT] Tactic: 0 time 0.400256 [07/23/2021-23:53:59] [V] [TRT] Fastest Tactic: 0 Time: 0.400256 [07/23/2021-23:53:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:59] [V] [TRT] Tactic: 1002 time 1.28205 [07/23/2021-23:53:59] [V] [TRT] Tactic: 0 time 0.654848 [07/23/2021-23:53:59] [V] [TRT] Fastest Tactic: 0 Time: 0.654848 [07/23/2021-23:53:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:59] [V] [TRT] Tactic: 1002 time 2.48947 [07/23/2021-23:53:59] [V] [TRT] Tactic: 0 time 1.1584 [07/23/2021-23:53:59] [V] [TRT] Fastest Tactic: 0 Time: 1.1584 [07/23/2021-23:53:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:53:59] [V] [TRT] Tactic: 1002 time 2.16294 [07/23/2021-23:54:00] [V] [TRT] Tactic: 0 time 48.1622 [07/23/2021-23:54:00] [V] [TRT] Fastest Tactic: 1002 Time: 2.16294 [07/23/2021-23:54:00] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:00] [V] [TRT] Tactic: 1002 time 1.29139 [07/23/2021-23:54:00] [V] [TRT] Tactic: 0 time 0.546176 [07/23/2021-23:54:00] [V] [TRT] Fastest Tactic: 0 Time: 0.546176 [07/23/2021-23:54:00] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:00] [V] [TRT] Tactic: 1002 time 2.50944 [07/23/2021-23:54:00] [V] [TRT] Tactic: 0 time 0.927616 [07/23/2021-23:54:00] [V] [TRT] Fastest Tactic: 0 Time: 0.927616 [07/23/2021-23:54:00] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:00] [V] [TRT] Tactic: 1002 time 2.5056 [07/23/2021-23:54:00] [V] [TRT] Tactic: 0 time 1.13114 [07/23/2021-23:54:00] [V] [TRT] Fastest Tactic: 0 Time: 1.13114 [07/23/2021-23:54:00] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:00] [V] [TRT] Tactic: 1002 time 0.534528 [07/23/2021-23:54:00] [V] [TRT] Tactic: 0 time 0.793216 [07/23/2021-23:54:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.534528 [07/23/2021-23:54:00] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:01] [V] [TRT] Tactic: 1002 time 2.42842 [07/23/2021-23:54:01] [V] [TRT] Tactic: 0 time 0.398336 [07/23/2021-23:54:01] [V] [TRT] Fastest Tactic: 0 Time: 0.398336 [07/23/2021-23:54:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:01] [V] [TRT] Tactic: 1002 time 2.49331 [07/23/2021-23:54:01] [V] [TRT] Tactic: 0 time 48.2518 [07/23/2021-23:54:01] [V] [TRT] Fastest Tactic: 1002 Time: 2.49331 [07/23/2021-23:54:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:02] [V] [TRT] Tactic: 1002 time 0.523264 [07/23/2021-23:54:02] [V] [TRT] Tactic: 0 time 0.699776 [07/23/2021-23:54:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.523264 [07/23/2021-23:54:02] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:02] [V] [TRT] Tactic: 1002 time 3.06202 [07/23/2021-23:54:02] [V] [TRT] Tactic: 0 time 1.088 [07/23/2021-23:54:02] [V] [TRT] Fastest Tactic: 0 Time: 1.088 [07/23/2021-23:54:02] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:02] [V] [TRT] Tactic: 1002 time 2.50112 [07/23/2021-23:54:02] [V] [TRT] Tactic: 0 time 1.15622 [07/23/2021-23:54:02] [V] [TRT] Fastest Tactic: 0 Time: 1.15622 [07/23/2021-23:54:02] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:02] [V] [TRT] Tactic: 1002 time 1.86253 [07/23/2021-23:54:02] [V] [TRT] Tactic: 0 time 1.82131 [07/23/2021-23:54:02] [V] [TRT] Fastest Tactic: 0 Time: 1.82131 [07/23/2021-23:54:02] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:02] [V] [TRT] Tactic: 1002 time 1.76934 [07/23/2021-23:54:02] [V] [TRT] Tactic: 0 time 0.716288 [07/23/2021-23:54:02] [V] [TRT] Fastest Tactic: 0 Time: 0.716288 [07/23/2021-23:54:02] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:02] [V] [TRT] Tactic: 1002 time 2.52262 [07/23/2021-23:54:02] [V] [TRT] Tactic: 0 time 1.50541 [07/23/2021-23:54:02] [V] [TRT] Fastest Tactic: 0 Time: 1.50541 [07/23/2021-23:54:02] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:02] [V] [TRT] Tactic: 1002 time 1.79072 [07/23/2021-23:54:02] [V] [TRT] Tactic: 0 time 1.74797 [07/23/2021-23:54:02] [V] [TRT] Fastest Tactic: 0 Time: 1.74797 [07/23/2021-23:54:02] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:03] [V] [TRT] Tactic: 1002 time 2.54067 [07/23/2021-23:54:03] [V] [TRT] Tactic: 0 time 2.11686 [07/23/2021-23:54:03] [V] [TRT] Fastest Tactic: 0 Time: 2.11686 [07/23/2021-23:54:03] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:03] [V] [TRT] Tactic: 1002 time 2.5289 [07/23/2021-23:54:03] [V] [TRT] Tactic: 0 time 1.49606 [07/23/2021-23:54:03] [V] [TRT] Fastest Tactic: 0 Time: 1.49606 [07/23/2021-23:54:03] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:03] [V] [TRT] Tactic: 1002 time 0.308608 [07/23/2021-23:54:03] [V] [TRT] Tactic: 0 time 0.40512 [07/23/2021-23:54:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.308608 [07/23/2021-23:54:03] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:03] [V] [TRT] Tactic: 1002 time 1.23622 [07/23/2021-23:54:03] [V] [TRT] Tactic: 0 time 0.263808 [07/23/2021-23:54:03] [V] [TRT] Fastest Tactic: 0 Time: 0.263808 [07/23/2021-23:54:03] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:03] [V] [TRT] Tactic: 1002 time 3.10451 [07/23/2021-23:54:03] [V] [TRT] Tactic: 0 time 1.07034 [07/23/2021-23:54:03] [V] [TRT] Fastest Tactic: 0 Time: 1.07034 [07/23/2021-23:54:03] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:03] [V] [TRT] Tactic: 1002 time 2.51187 [07/23/2021-23:54:04] [V] [TRT] Tactic: 0 time 48.0685 [07/23/2021-23:54:04] [V] [TRT] Fastest Tactic: 1002 Time: 2.51187 [07/23/2021-23:54:04] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:04] [V] [TRT] Tactic: 1002 time 2.53875 [07/23/2021-23:54:04] [V] [TRT] Tactic: 0 time 0.22144 [07/23/2021-23:54:04] [V] [TRT] Fastest Tactic: 0 Time: 0.22144 [07/23/2021-23:54:04] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:04] [V] [TRT] Tactic: 1002 time 3.11232 [07/23/2021-23:54:04] [V] [TRT] Tactic: 0 time 0.316416 [07/23/2021-23:54:04] [V] [TRT] Fastest Tactic: 0 Time: 0.316416 [07/23/2021-23:54:04] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:04] [V] [TRT] Tactic: 1002 time 0.520576 [07/23/2021-23:54:04] [V] [TRT] Tactic: 0 time 0.341248 [07/23/2021-23:54:04] [V] [TRT] Fastest Tactic: 0 Time: 0.341248 [07/23/2021-23:54:04] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:05] [V] [TRT] Tactic: 1002 time 2.44518 [07/23/2021-23:54:05] [V] [TRT] Tactic: 0 time 0.28608 [07/23/2021-23:54:05] [V] [TRT] Fastest Tactic: 0 Time: 0.28608 [07/23/2021-23:54:05] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:05] [V] [TRT] Tactic: 1002 time 3.0807 [07/23/2021-23:54:05] [V] [TRT] Tactic: 0 time 1.10336 [07/23/2021-23:54:05] [V] [TRT] Fastest Tactic: 0 Time: 1.10336 [07/23/2021-23:54:05] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:05] [V] [TRT] Tactic: 1002 time 2.50035 [07/23/2021-23:54:06] [V] [TRT] Tactic: 0 time 48.0003 [07/23/2021-23:54:06] [V] [TRT] Fastest Tactic: 1002 Time: 2.50035 [07/23/2021-23:54:06] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:06] [V] [TRT] Tactic: 1002 time 0.507904 [07/23/2021-23:54:06] [V] [TRT] Tactic: 0 time 0.247552 [07/23/2021-23:54:06] [V] [TRT] Fastest Tactic: 0 Time: 0.247552 [07/23/2021-23:54:06] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:06] [V] [TRT] Tactic: 1002 time 3.11565 [07/23/2021-23:54:06] [V] [TRT] Tactic: 0 time 0.339456 [07/23/2021-23:54:06] [V] [TRT] Fastest Tactic: 0 Time: 0.339456 [07/23/2021-23:54:06] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:06] [V] [TRT] Tactic: 1002 time 0.551936 [07/23/2021-23:54:06] [V] [TRT] Tactic: 0 time 0.397952 [07/23/2021-23:54:06] [V] [TRT] Fastest Tactic: 0 Time: 0.397952 [07/23/2021-23:54:06] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:06] [V] [TRT] Tactic: 1002 time 2.42906 [07/23/2021-23:54:06] [V] [TRT] Tactic: 0 time 0.399104 [07/23/2021-23:54:06] [V] [TRT] Fastest Tactic: 0 Time: 0.399104 [07/23/2021-23:54:06] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:06] [V] [TRT] Tactic: 1002 time 2.51238 [07/23/2021-23:54:06] [V] [TRT] Tactic: 0 time 1.17837 [07/23/2021-23:54:06] [V] [TRT] Fastest Tactic: 0 Time: 1.17837 [07/23/2021-23:54:06] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:06] [V] [TRT] Tactic: 1002 time 2.48768 [07/23/2021-23:54:07] [V] [TRT] Tactic: 0 time 48.1784 [07/23/2021-23:54:07] [V] [TRT] Fastest Tactic: 1002 Time: 2.48768 [07/23/2021-23:54:07] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:07] [V] [TRT] Tactic: 1002 time 0.540944 [07/23/2021-23:54:07] [V] [TRT] Tactic: 0 time 0.305792 [07/23/2021-23:54:07] [V] [TRT] Fastest Tactic: 0 Time: 0.305792 [07/23/2021-23:54:07] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:07] [V] [TRT] Tactic: 1002 time 3.0743 [07/23/2021-23:54:07] [V] [TRT] Tactic: 0 time 0.339328 [07/23/2021-23:54:07] [V] [TRT] Fastest Tactic: 0 Time: 0.339328 [07/23/2021-23:54:07] [V] [TRT] *************** Autotuning format combination: Float(1,1024,1048576,3145728) -> Float(1,3,3072,3145728) *************** [07/23/2021-23:54:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd__325 (Shuffle) [07/23/2021-23:54:08] [V] [TRT] Tactic: 0 time 0.343296 [07/23/2021-23:54:08] [V] [TRT] Tactic: 1 time 1.23187 [07/23/2021-23:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.343296 [07/23/2021-23:54:08] [V] [TRT] *************** Autotuning format combination: Float(3,3072,1,3145728) -> Float(1024,3072,1,3145728) *************** [07/23/2021-23:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd__325 (Shuffle) [07/23/2021-23:54:08] [V] [TRT] Tactic: 0 time 0.833792 [07/23/2021-23:54:08] [V] [TRT] Tactic: 1 time 0.370712 [07/23/2021-23:54:08] [V] [TRT] Fastest Tactic: 1 Time: 0.370712 [07/23/2021-23:54:08] [V] [TRT] *************** Autotuning format combination: Float(1,1024,1:4,1048576) -> Float(256,768,1:4,786432) *************** [07/23/2021-23:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd__325 (Shuffle) [07/23/2021-23:54:08] [V] [TRT] Tactic: 0 time 1.01606 [07/23/2021-23:54:08] [V] [TRT] Tactic: 1 time 4.30862 [07/23/2021-23:54:08] [V] [TRT] Fastest Tactic: 0 Time: 1.01606 [07/23/2021-23:54:08] [V] [TRT] *************** Autotuning format combination: Float(1,1024,1048576:32,1048576) -> Float(1,3,3072:32,98304) *************** [07/23/2021-23:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd__325 (Shuffle) [07/23/2021-23:54:08] [V] [TRT] Tactic: 0 time 0.822036 [07/23/2021-23:54:08] [V] [TRT] Tactic: 1 time 4.36006 [07/23/2021-23:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.822036 [07/23/2021-23:54:08] [V] [TRT] *************** Autotuning format combination: Half(1,1024,1048576,3145728) -> Half(1,3,3072,3145728) *************** [07/23/2021-23:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd__325 (Shuffle) [07/23/2021-23:54:08] [V] [TRT] Tactic: 0 time 0.192516 [07/23/2021-23:54:08] [V] [TRT] Tactic: 1 time 1.25952 [07/23/2021-23:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.192516 [07/23/2021-23:54:08] [V] [TRT] *************** Autotuning format combination: Half(1,1024,1048576:2,2097152) -> Half(1,3,3072:2,1572864) *************** [07/23/2021-23:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd__325 (Shuffle) [07/23/2021-23:54:08] [V] [TRT] Tactic: 0 time 0.228608 [07/23/2021-23:54:08] [V] [TRT] Tactic: 1 time 4.40781 [07/23/2021-23:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.228608 [07/23/2021-23:54:08] [V] [TRT] *************** Autotuning format combination: Half(1,1024,1:8,1048576) -> Half(128,384,1:8,393216) *************** [07/23/2021-23:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/output/BiasAdd__325 (Shuffle) [07/23/2021-23:54:08] [V] [TRT] Tactic: 0 time 0.779776 [07/23/2021-23:54:08] [V] [TRT] Tactic: 1 time 4.42304 [07/23/2021-23:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.779776 [07/23/2021-23:54:08] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:09] [V] [TRT] Tactic: 1002 time 0.376192 [07/23/2021-23:54:09] [V] [TRT] Tactic: 0 time 0.461312 [07/23/2021-23:54:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.376192 [07/23/2021-23:54:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:09] [V] [TRT] Tactic: 1002 time 0.391936 [07/23/2021-23:54:09] [V] [TRT] Tactic: 0 time 0.46208 [07/23/2021-23:54:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.391936 [07/23/2021-23:54:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:09] [V] [TRT] Tactic: 1002 time 0.509312 [07/23/2021-23:54:09] [V] [TRT] Tactic: 0 time 0.368896 [07/23/2021-23:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.368896 [07/23/2021-23:54:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:09] [V] [TRT] Tactic: 1002 time 0.308352 [07/23/2021-23:54:09] [V] [TRT] Tactic: 0 time 0.403968 [07/23/2021-23:54:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.308352 [07/23/2021-23:54:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:09] [V] [TRT] Tactic: 1002 time 0.501504 [07/23/2021-23:54:09] [V] [TRT] Tactic: 0 time 0.253312 [07/23/2021-23:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.253312 [07/23/2021-23:54:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/23/2021-23:54:09] [V] [TRT] Tactic: 1002 time 0.349312 [07/23/2021-23:54:09] [V] [TRT] Tactic: 0 time 0.269184 [07/23/2021-23:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.269184 [07/23/2021-23:54:09] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu reformatted input 0 (StatefulPartitionedCall/model/conv2d/BiasAdd__9:0) from Float(1,256,65536,196608) to Half(1,256,1:8,65536) [07/23/2021-23:54:09] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose reformatted input 0 (StatefulPartitionedCall/model/conv2d_3/Relu:0) from Half(4,1024,1:8,262144) to Float(1,256,65536,2097152) [07/23/2021-23:54:09] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/model/lambda/DepthToSpace reformatted input 0 (StatefulPartitionedCall/model/conv2d_4/Relu:0) from Half(32,8192,1:8,2097152) to Half(1,256,65536,16777216) [07/23/2021-23:54:09] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu reformatted input 0 (StatefulPartitionedCall/model/lambda/DepthToSpace:0) from Half(1,512,262144,16777216) to Half(8,4096,1:8,2097152) [07/23/2021-23:54:09] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/model/lambda_1/DepthToSpace reformatted input 0 (StatefulPartitionedCall/model/conv2d_5/Relu:0) from Half(32,16384,1:8,8388608) to Half(1,512,262144,67108864) [07/23/2021-23:54:09] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/model/output/BiasAdd reformatted input 0 (StatefulPartitionedCall/model/lambda_1/DepthToSpace:0) from Half(1,1024,1048576,67108864) to Half(8,8192,1:8,8388608) [07/23/2021-23:54:09] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/model/output/BiasAdd__325 reformatted input 0 (StatefulPartitionedCall/model/output/BiasAdd:0) from Half(1,1024,1:8,1048576) to Float(1,1024,1048576,3145728) [07/23/2021-23:54:09] [V] [TRT] For layer StatefulPartitionedCall/model/conv2d/BiasAdd__9 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/23/2021-23:54:09] [V] [TRT] For layer StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/23/2021-23:54:09] [V] [TRT] For layer StatefulPartitionedCall/model/output/BiasAdd__325 a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation. [07/23/2021-23:54:09] [V] [TRT] Formats and tactics selection completed in 507.818 seconds. [07/23/2021-23:54:09] [V] [TRT] After reformat layers: 32 layers [07/23/2021-23:54:09] [V] [TRT] Block size 41943040000 [07/23/2021-23:54:09] [V] [TRT] Block size 1073741824 [07/23/2021-23:54:09] [V] [TRT] Block size 1073741824 [07/23/2021-23:54:09] [V] [TRT] Block size 134217728 [07/23/2021-23:54:09] [V] [TRT] Total Activation Memory: 44224741376 [07/23/2021-23:54:09] [I] [TRT] Detected 1 inputs and 1 output network tensors. [07/23/2021-23:54:09] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:54:09] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 [07/23/2021-23:54:09] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu (h16816cudnn) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 [07/23/2021-23:54:09] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:54:09] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu (fprop) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_256x128x32x1_16x8x16_3stages [07/23/2021-23:54:09] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu (h1688cudnn) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 [07/23/2021-23:54:09] [V] [TRT] StatefulPartitionedCall/model/output/BiasAdd (fprop_indexed) Set Tactic Name: trt_ampere_xmma_implicit_gemm_f16f16f16_nhwc_nhwc_fprop_indexed_256x32x32x1_16x8x16_4stages [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d/BiasAdd__9 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu Weights: 0 HostPersistent: 1664 DevicePersistent: 431104 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu Weights: 0 HostPersistent: 2176 DevicePersistent: 983552 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu Weights: 0 HostPersistent: 2176 DevicePersistent: 541184 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu Weights: 0 HostPersistent: 1296 DevicePersistent: 37376 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose Weights: 36864 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: Slice__95 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: const_fold_opt__478 + StatefulPartitionedCall/model/conv2d_transpose/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose/Relu Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose Weights: 36864 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: Slice__157 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: const_fold_opt__475 + StatefulPartitionedCall/model/conv2d_transpose_1/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_1/Relu Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose Weights: 147456 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: Slice__219 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: const_fold_opt__476 + StatefulPartitionedCall/model/conv2d_transpose_2/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_2/Relu Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose Weights: 589824 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: Slice__281 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: const_fold_opt__480 + StatefulPartitionedCall/model/conv2d_transpose_3/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_3/Relu Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu Weights: 0 HostPersistent: 1760 DevicePersistent: 1181184 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/lambda/DepthToSpace input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/lambda/DepthToSpace Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu Weights: 0 HostPersistent: 1664 DevicePersistent: 1868800 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/lambda_1/DepthToSpace input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/lambda_1/DepthToSpace Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/output/BiasAdd input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/output/BiasAdd Weights: 0 HostPersistent: 1296 DevicePersistent: 9728 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/output/BiasAdd__325 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Layer: StatefulPartitionedCall/model/output/BiasAdd__325 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/23/2021-23:54:09] [V] [TRT] Total Host Persistent Memory: 12032 [07/23/2021-23:54:09] [V] [TRT] Total Device Persistent Memory: 5052928 [07/23/2021-23:54:09] [V] [TRT] Total Weight Memory: 811008 [07/23/2021-23:54:09] [V] [TRT] Engine generation completed in 508.613 seconds. [07/23/2021-23:54:09] [V] [TRT] Builder timing cache: created 432 entries, 270 hit(s) [07/23/2021-23:54:09] [V] [TRT] Engine Layer Information: [07/23/2021-23:54:09] [V] [TRT] Layer(Shuffle): StatefulPartitionedCall/model/conv2d/BiasAdd__9, Tactic: 0, input[Float(256,256,3)] -> StatefulPartitionedCall/model/conv2d/BiasAdd__9:0[Float(3,256,256)] [07/23/2021-23:54:09] [V] [TRT] Layer(Reformat): StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu input reformatter 0, Tactic: 0, StatefulPartitionedCall/model/conv2d/BiasAdd__9:0[Float(3,256,256)] -> StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu reformatted input 0[Half(3,256,256)] [07/23/2021-23:54:09] [V] [TRT] Layer(h1688cudnn): StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu, Tactic: 8839784824303350101, StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/conv2d/Relu reformatted input 0[Half(3,256,256)] -> StatefulPartitionedCall/model/conv2d/Relu:0[Half(256,256,256)] [07/23/2021-23:54:09] [V] [TRT] Layer(h1688cudnn): StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/conv2d_1/Relu, Tactic: 1156328698016730421, StatefulPartitionedCall/model/conv2d/Relu:0[Half(256,256,256)] -> StatefulPartitionedCall/model/conv2d_1/Relu:0[Half(128,256,256)] [07/23/2021-23:54:09] [V] [TRT] Layer(h16816cudnn): StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/conv2d_2/Relu, Tactic: 7609923741161019135, StatefulPartitionedCall/model/conv2d_1/Relu:0[Half(128,256,256)] -> StatefulPartitionedCall/model/conv2d_2/Relu:0[Half(64,256,256)] [07/23/2021-23:54:09] [V] [TRT] Layer(fprop_indexed): StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/conv2d_3/Relu, Tactic: 5896806418498994339, StatefulPartitionedCall/model/conv2d_2/Relu:0[Half(64,256,256)] -> StatefulPartitionedCall/model/conv2d_3/Relu:0[Half(32,256,256)] [07/23/2021-23:54:09] [V] [TRT] Layer(Reformat): StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose input reformatter 0, Tactic: 0, StatefulPartitionedCall/model/conv2d_3/Relu:0[Half(32,256,256)] -> StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose reformatted input 0[Float(32,256,256)] [07/23/2021-23:54:09] [V] [TRT] Layer(Deconvolution): StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose, Tactic: 4, StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose reformatted input 0[Float(32,256,256)] -> StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose:0[Float(32,258,258)] [07/23/2021-23:54:09] [V] [TRT] Layer(Reformat): Slice__95, Tactic: 0, StatefulPartitionedCall/model/conv2d_transpose/conv2d_transpose:0[Float(32,256,256)] -> Slice__95:0[Half(32,256,256)] [07/23/2021-23:54:09] [V] [TRT] Layer(Scale): const_fold_opt__478 + StatefulPartitionedCall/model/conv2d_transpose/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose/Relu, Tactic: 0, Slice__95:0[Half(32,256,256)] -> StatefulPartitionedCall/model/conv2d_transpose/Relu:0[Half(32,256,256)] [07/23/2021-23:54:09] [V] [TRT] Layer(gemmDeconvolution): StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose, Tactic: 0, StatefulPartitionedCall/model/conv2d_transpose/Relu:0[Half(32,256,256)] -> StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose:0[Half(64,258,258)] [07/23/2021-23:54:09] [V] [TRT] Layer(Reformat): Slice__157, Tactic: 0, StatefulPartitionedCall/model/conv2d_transpose_1/conv2d_transpose:0[Half(64,256,256)] -> Slice__157:0[Half(64,256,256)] [07/23/2021-23:54:09] [V] [TRT] Layer(Scale): const_fold_opt__475 + StatefulPartitionedCall/model/conv2d_transpose_1/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_1/Relu, Tactic: 0, Slice__157:0[Half(64,256,256)] -> StatefulPartitionedCall/model/conv2d_transpose_1/Relu:0[Half(64,256,256)] [07/23/2021-23:54:09] [V] [TRT] Layer(gemmDeconvolution): StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose, Tactic: 0, StatefulPartitionedCall/model/conv2d_transpose_1/Relu:0[Half(64,256,256)] -> StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose:0[Half(128,258,258)] [07/23/2021-23:54:09] [V] [TRT] Layer(Reformat): Slice__219, Tactic: 0, StatefulPartitionedCall/model/conv2d_transpose_2/conv2d_transpose:0[Half(128,256,256)] -> Slice__219:0[Half(128,256,256)] [07/23/2021-23:54:09] [V] [TRT] Layer(Scale): const_fold_opt__476 + StatefulPartitionedCall/model/conv2d_transpose_2/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_2/Relu, Tactic: 0, Slice__219:0[Half(128,256,256)] -> StatefulPartitionedCall/model/conv2d_transpose_2/Relu:0[Half(128,256,256)] [07/23/2021-23:54:09] [V] [TRT] Layer(gemmDeconvolution): StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose, Tactic: 0, StatefulPartitionedCall/model/conv2d_transpose_2/Relu:0[Half(128,256,256)] -> StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose:0[Half(256,258,258)] [07/23/2021-23:54:09] [V] [TRT] Layer(Reformat): Slice__281, Tactic: 0, StatefulPartitionedCall/model/conv2d_transpose_3/conv2d_transpose:0[Half(256,256,256)] -> Slice__281:0[Half(256,256,256)] [07/23/2021-23:54:09] [V] [TRT] Layer(Scale): const_fold_opt__480 + StatefulPartitionedCall/model/conv2d_transpose_3/BiasAdd + StatefulPartitionedCall/model/conv2d_transpose_3/Relu, Tactic: 0, Slice__281:0[Half(256,256,256)] -> StatefulPartitionedCall/model/conv2d_transpose_3/Relu:0[Half(256,256,256)] [07/23/2021-23:54:09] [V] [TRT] Layer(fprop): StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/conv2d_4/Relu, Tactic: -5421613452990385135, StatefulPartitionedCall/model/conv2d_transpose_3/Relu:0[Half(256,256,256)] -> StatefulPartitionedCall/model/conv2d_4/Relu:0[Half(256,256,256)] [07/23/2021-23:54:09] [V] [TRT] Layer(Reformat): StatefulPartitionedCall/model/lambda/DepthToSpace input reformatter 0, Tactic: 0, StatefulPartitionedCall/model/conv2d_4/Relu:0[Half(256,256,256)] -> StatefulPartitionedCall/model/lambda/DepthToSpace reformatted input 0[Half(256,256,256)] [07/23/2021-23:54:09] [V] [TRT] Layer(Shuffle): StatefulPartitionedCall/model/lambda/DepthToSpace, Tactic: 0, StatefulPartitionedCall/model/lambda/DepthToSpace reformatted input 0[Half(256,256,256)] -> (Unnamed Layer* 259) [Shuffle]_output[Half(64,256,2,256,2)] [07/23/2021-23:54:09] [V] [TRT] Layer(Reformat): StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu input reformatter 0, Tactic: 0, StatefulPartitionedCall/model/lambda/DepthToSpace:0[Half(64,512,512)] -> StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu reformatted input 0[Half(64,512,512)] [07/23/2021-23:54:09] [V] [TRT] Layer(h1688cudnn): StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu, Tactic: 3704534001553878387, StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/conv2d_5/Relu reformatted input 0[Half(64,512,512)] -> StatefulPartitionedCall/model/conv2d_5/Relu:0[Half(256,512,512)] [07/23/2021-23:54:09] [V] [TRT] Layer(Reformat): StatefulPartitionedCall/model/lambda_1/DepthToSpace input reformatter 0, Tactic: 0, StatefulPartitionedCall/model/conv2d_5/Relu:0[Half(256,512,512)] -> StatefulPartitionedCall/model/lambda_1/DepthToSpace reformatted input 0[Half(256,512,512)] [07/23/2021-23:54:09] [V] [TRT] Layer(Shuffle): StatefulPartitionedCall/model/lambda_1/DepthToSpace, Tactic: 0, StatefulPartitionedCall/model/lambda_1/DepthToSpace reformatted input 0[Half(256,512,512)] -> (Unnamed Layer* 282) [Shuffle]_output[Half(64,512,2,512,2)] [07/23/2021-23:54:09] [V] [TRT] Layer(Reformat): StatefulPartitionedCall/model/output/BiasAdd input reformatter 0, Tactic: 0, StatefulPartitionedCall/model/lambda_1/DepthToSpace:0[Half(64,1024,1024)] -> StatefulPartitionedCall/model/output/BiasAdd reformatted input 0[Half(64,1024,1024)] [07/23/2021-23:54:09] [V] [TRT] Layer(fprop_indexed): StatefulPartitionedCall/model/output/BiasAdd, Tactic: 5896806418498994339, StatefulPartitionedCall/model/output/BiasAdd reformatted input 0[Half(64,1024,1024)] -> StatefulPartitionedCall/model/output/BiasAdd:0[Half(3,1024,1024)] [07/23/2021-23:54:09] [V] [TRT] Layer(Reformat): StatefulPartitionedCall/model/output/BiasAdd__325 input reformatter 0, Tactic: 0, StatefulPartitionedCall/model/output/BiasAdd:0[Half(3,1024,1024)] -> StatefulPartitionedCall/model/output/BiasAdd__325 reformatted input 0[Float(3,1024,1024)] [07/23/2021-23:54:09] [V] [TRT] Layer(Shuffle): StatefulPartitionedCall/model/output/BiasAdd__325, Tactic: 0, StatefulPartitionedCall/model/output/BiasAdd__325 reformatted input 0[Float(3,1024,1024)] -> output[Float(1024,1024,3)] [07/23/2021-23:54:09] [I] Engine built in 514.103 sec. [07/23/2021-23:54:09] [V] [TRT] Allocated persistent device memory of size 5052928 [07/23/2021-23:54:09] [V] [TRT] Allocated activation device memory of size 2841731584 [07/23/2021-23:54:09] [V] [TRT] Assigning persistent memory blocks for various profiles [07/23/2021-23:54:09] [I] Starting inference [07/23/2021-23:54:13] [I] Warmup completed 0 queries over 200 ms [07/23/2021-23:54:13] [I] Timing trace has 0 queries over 3.1507 s [07/23/2021-23:54:13] [I] Trace averages of 10 runs: [07/23/2021-23:54:13] [I] Average on 10 runs - GPU latency: 53.418 ms - Host latency: 59.3959 ms (end to end 105.826 ms, enqueue 0.545033 ms) [07/23/2021-23:54:13] [I] Average on 10 runs - GPU latency: 52.9058 ms - Host latency: 58.7256 ms (end to end 105.182 ms, enqueue 0.583185 ms) [07/23/2021-23:54:13] [I] Average on 10 runs - GPU latency: 51.9438 ms - Host latency: 57.8527 ms (end to end 103.464 ms, enqueue 0.628967 ms) [07/23/2021-23:54:13] [I] Average on 10 runs - GPU latency: 52.3663 ms - Host latency: 58.2844 ms (end to end 104.267 ms, enqueue 0.621374 ms) [07/23/2021-23:54:13] [I] Average on 10 runs - GPU latency: 52.0702 ms - Host latency: 58.0552 ms (end to end 103.684 ms, enqueue 0.624829 ms) [07/23/2021-23:54:13] [I] Host Latency [07/23/2021-23:54:13] [I] min: 57.5105 ms (end to end 103.019 ms) [07/23/2021-23:54:13] [I] max: 60.5594 ms (end to end 107.843 ms) [07/23/2021-23:54:13] [I] mean: 58.4137 ms (end to end 104.406 ms) [07/23/2021-23:54:13] [I] median: 58.1831 ms (end to end 103.953 ms) [07/23/2021-23:54:13] [I] percentile: 60.5594 ms at 99% (end to end 107.843 ms at 99%) [07/23/2021-23:54:13] [I] throughput: 0 qps [07/23/2021-23:54:13] [I] walltime: 3.1507 s [07/23/2021-23:54:13] [I] Enqueue Time [07/23/2021-23:54:13] [I] min: 0.323303 ms [07/23/2021-23:54:13] [I] max: 0.650391 ms [07/23/2021-23:54:13] [I] median: 0.622437 ms [07/23/2021-23:54:13] [I] GPU Compute [07/23/2021-23:54:13] [I] min: 51.8347 ms [07/23/2021-23:54:13] [I] max: 54.4881 ms [07/23/2021-23:54:13] [I] mean: 52.4991 ms [07/23/2021-23:54:13] [I] median: 52.2136 ms [07/23/2021-23:54:13] [I] percentile: 54.4881 ms at 99% [07/23/2021-23:54:13] [I] total compute time: 3.09745 s &&&& PASSED TensorRT.trtexec # trtexec --onnx=/weights/onnx/model.onnx --shapes=input:8x256x256x3 --fp16 --workspace=40000 --verbose