&&&& RUNNING TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=resnet50-512_unsqueezed_float.onnx --explicitBatch --verbose --fp16
[08/16/2021-04:50:06] [I] === Model Options ===
[08/16/2021-04:50:06] [I] Format: ONNX
[08/16/2021-04:50:06] [I] Model: resnet50-512_unsqueezed_float.onnx
[08/16/2021-04:50:06] [I] Output:
[08/16/2021-04:50:06] [I] === Build Options ===
[08/16/2021-04:50:06] [I] Max batch: explicit
[08/16/2021-04:50:06] [I] Workspace: 16 MB
[08/16/2021-04:50:06] [I] minTiming: 1
[08/16/2021-04:50:06] [I] avgTiming: 8
[08/16/2021-04:50:06] [I] Precision: FP32+FP16
[08/16/2021-04:50:06] [I] Calibration: 
[08/16/2021-04:50:06] [I] Safe mode: Disabled
[08/16/2021-04:50:06] [I] Save engine: 
[08/16/2021-04:50:06] [I] Load engine: 
[08/16/2021-04:50:06] [I] Builder Cache: Enabled
[08/16/2021-04:50:06] [I] NVTX verbosity: 0
[08/16/2021-04:50:06] [I] Inputs format: fp32:CHW
[08/16/2021-04:50:06] [I] Outputs format: fp32:CHW
[08/16/2021-04:50:06] [I] Input build shapes: model
[08/16/2021-04:50:06] [I] Input calibration shapes: model
[08/16/2021-04:50:06] [I] === System Options ===
[08/16/2021-04:50:06] [I] Device: 0
[08/16/2021-04:50:06] [I] DLACore: 
[08/16/2021-04:50:06] [I] Plugins:
[08/16/2021-04:50:06] [I] === Inference Options ===
[08/16/2021-04:50:06] [I] Batch: Explicit
[08/16/2021-04:50:06] [I] Input inference shapes: model
[08/16/2021-04:50:06] [I] Iterations: 10
[08/16/2021-04:50:06] [I] Duration: 3s (+ 200ms warm up)
[08/16/2021-04:50:06] [I] Sleep time: 0ms
[08/16/2021-04:50:06] [I] Streams: 1
[08/16/2021-04:50:06] [I] ExposeDMA: Disabled
[08/16/2021-04:50:06] [I] Spin-wait: Disabled
[08/16/2021-04:50:06] [I] Multithreading: Disabled
[08/16/2021-04:50:06] [I] CUDA Graph: Disabled
[08/16/2021-04:50:06] [I] Skip inference: Disabled
[08/16/2021-04:50:06] [I] Inputs:
[08/16/2021-04:50:06] [I] === Reporting Options ===
[08/16/2021-04:50:06] [I] Verbose: Enabled
[08/16/2021-04:50:06] [I] Averages: 10 inferences
[08/16/2021-04:50:06] [I] Percentile: 99
[08/16/2021-04:50:06] [I] Dump output: Disabled
[08/16/2021-04:50:06] [I] Profile: Disabled
[08/16/2021-04:50:06] [I] Export timing to JSON file: 
[08/16/2021-04:50:06] [I] Export output to JSON file: 
[08/16/2021-04:50:06] [I] Export profile to JSON file: 
[08/16/2021-04:50:06] [I] 
[08/16/2021-04:50:06] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1
[08/16/2021-04:50:06] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1
[08/16/2021-04:50:06] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1
[08/16/2021-04:50:06] [V] [TRT] Registered plugin creator - ::Region_TRT version 1
[08/16/2021-04:50:06] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1
[08/16/2021-04:50:06] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1
[08/16/2021-04:50:06] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1
[08/16/2021-04:50:06] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1
[08/16/2021-04:50:06] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1
[08/16/2021-04:50:06] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1
[08/16/2021-04:50:06] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1
[08/16/2021-04:50:06] [V] [TRT] Registered plugin creator - ::CropAndResize version 1
[08/16/2021-04:50:06] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1
[08/16/2021-04:50:06] [V] [TRT] Registered plugin creator - ::Proposal version 1
[08/16/2021-04:50:06] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1
[08/16/2021-04:50:06] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1
[08/16/2021-04:50:06] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1
[08/16/2021-04:50:06] [V] [TRT] Registered plugin creator - ::Split version 1
[08/16/2021-04:50:06] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1
[08/16/2021-04:50:06] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1
----------------------------------------------------------------
Input filename:   resnet50-512_unsqueezed_float.onnx
ONNX IR version:  0.0.7
Opset version:    12
Producer name:    
Producer version: 
Domain:           
Model version:    0
Doc string:       
----------------------------------------------------------------
[08/16/2021-04:50:08] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1
[08/16/2021-04:50:08] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1
[08/16/2021-04:50:08] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1
[08/16/2021-04:50:08] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1
[08/16/2021-04:50:08] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1
[08/16/2021-04:50:08] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1
[08/16/2021-04:50:08] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1
[08/16/2021-04:50:08] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1
[08/16/2021-04:50:08] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1
[08/16/2021-04:50:08] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1
[08/16/2021-04:50:08] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1
[08/16/2021-04:50:08] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1
[08/16/2021-04:50:08] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1
[08/16/2021-04:50:08] [V] [TRT] Plugin creator already registered - ::Proposal version 1
[08/16/2021-04:50:08] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1
[08/16/2021-04:50:08] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[08/16/2021-04:50:08] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1
[08/16/2021-04:50:08] [V] [TRT] Plugin creator already registered - ::Split version 1
[08/16/2021-04:50:08] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1
[08/16/2021-04:50:08] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:202: Adding network input: input_tensor:0 with dtype: float32, dimensions: (1, 512, 512, 3)
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:116: Registering tensor: input_tensor:0 for ONNX tensor: input_tensor:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/Preprocessor/sub/y:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: Const__743
[08/16/2021-04:50:08] [08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_zero__13
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_two__14
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__803
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: roi__12
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: new_shape__809
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/Conv2D/ReadVariableOp:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd/ReadVariableOp:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/Conv2D/ReadVariableOp:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd/ReadVariableOp:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/Conv2D/ReadVariableOp:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd/ReadVariableOp:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1/ReadVariableOp:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1/ReadVariableOp:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D/ReadVariableOp:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/ReadVariableOp:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/ReadVariableOp_1:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/ReadVariableOp:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/ReadVariableOp_1:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/ReadVariableOp:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/ReadVariableOp_1:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/FusedBatchNormV3/ReadVariableOp:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/FusedBatchNormV3/ReadVariableOp_1:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_2_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_2_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_2_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_2_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_3_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_3_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__807
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_2_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_2_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_2_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_2_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_3_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_3_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_4_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_4_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/Conv2D_2/ReadVariableOp:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3/ReadVariableOp:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/Conv2D_4/ReadVariableOp:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4/ReadVariableOp:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_3_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_3_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_3_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_3_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_4_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_4_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__802
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__797
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_4_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_4_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_4_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_4_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_1_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_1_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_1_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_1_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_1_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_1_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__806
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_1_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_1_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_1_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_1_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__792
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_2_recip:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_1_recip:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/sub:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/sub_1:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/add_1:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/add:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/truediv_recip:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__808
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Cast [Cast]
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: input_tensor:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Cast [Cast] inputs: [input_tensor:0 -> (1, 512, 512, 3)], 
[08/16/2021-04:50:08] [V] [TRT] builtin_op_importers.cpp:320: Casting to type: float32
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Cast for ONNX node: StatefulPartitionedCall/Cast
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Cast:0 for ONNX tensor: StatefulPartitionedCall/Cast:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Cast [Cast] outputs: [StatefulPartitionedCall/Cast:0 -> (1, 512, 512, 3)], 
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Preprocessor/sub [Sub]
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Cast:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Preprocessor/sub/y:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Preprocessor/sub [Sub] inputs: [StatefulPartitionedCall/Cast:0 -> (1, 512, 512, 3)], [StatefulPartitionedCall/Preprocessor/sub/y:0 -> (1, 1, 3)], 
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Preprocessor/sub for ONNX node: StatefulPartitionedCall/Preprocessor/sub
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Preprocessor/sub:0 for ONNX tensor: StatefulPartitionedCall/Preprocessor/sub:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Preprocessor/sub [Sub] outputs: [StatefulPartitionedCall/Preprocessor/sub:0 -> (1, 512, 512, 3)], 
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Preprocessor/unstack [Split]
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Preprocessor/sub:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Preprocessor/unstack [Split] inputs: [StatefulPartitionedCall/Preprocessor/sub:0 -> (1, 512, 512, 3)], 
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Preprocessor/unstack for ONNX node: StatefulPartitionedCall/Preprocessor/unstack
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Preprocessor/unstack:0 for ONNX tensor: StatefulPartitionedCall/Preprocessor/unstack:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Preprocessor/unstack [Split] outputs: [StatefulPartitionedCall/Preprocessor/unstack:0 -> (1, 512, 512, 3)], 
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose__663 [Transpose]
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Preprocessor/unstack:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:125: Transpose__663 [Transpose] inputs: [StatefulPartitionedCall/Preprocessor/unstack:0 -> (1, 512, 512, 3)], 
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:141: Registering layer: Transpose__663 for ONNX node: Transpose__663
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:116: Registering tensor: Transpose__663:0 for ONNX tensor: Transpose__663:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:179: Transpose__663 [Transpose] outputs: [Transpose__663:0 -> (1, 3, 512, 512)], 
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape__742 [Shape]
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Preprocessor/unstack:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:125: Shape__742 [Shape] inputs: [StatefulPartitionedCall/Preprocessor/unstack:0 -> (1, 512, 512, 3)], 
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:141: Registering layer: Shape__742 for ONNX node: Shape__742
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:116: Registering tensor: Shape__742:0 for ONNX tensor: Shape__742:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:179: Shape__742 [Shape] outputs: [Shape__742:0 -> (4)], 
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather__744 [Gather]
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: Shape__742:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: Const__743
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:125: Gather__744 [Gather] inputs: [Shape__742:0 -> (4)], [Const__743 -> (4)], 
[08/16/2021-04:50:08] [V] [TRT] builtin_op_importers.cpp:986: Using Gather axis: 0
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:141: Registering layer: Gather__744 for ONNX node: Gather__744
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:116: Registering tensor: Shape__17:0 for ONNX tensor: Shape__17:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:179: Gather__744 [Gather] outputs: [Shape__17:0 -> (4)], 
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice__18 [Slice]
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: Shape__17:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_zero__13
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_two__14
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:125: Slice__18 [Slice] inputs: [Shape__17:0 -> (4)], [const_zero__13 -> (1)], [const_two__14 -> (1)], 
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:141: Registering layer: Slice__18 for ONNX node: Slice__18
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:116: Registering tensor: Slice__18:0 for ONNX tensor: Slice__18:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:179: Slice__18 [Slice] outputs: [Slice__18:0 -> (2)], 
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat__20 [Concat]
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: Slice__18:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__803
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:125: Concat__20 [Concat] inputs: [Slice__18:0 -> (2)], [const_fold_opt__803 -> (2)], 
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:141: Registering layer: Concat__20 for ONNX node: Concat__20
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:116: Registering tensor: Concat__20:0 for ONNX tensor: Concat__20:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:179: Concat__20 [Concat] outputs: [Concat__20:0 -> (4)], 
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:103: Parsing node: Resize__21 [Resize]
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: Transpose__663:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: roi__12
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: roi__12
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: Concat__20:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:125: Resize__21 [Resize] inputs: [Transpose__663:0 -> (1, 3, 512, 512)], [roi__12 -> ()], [roi__12 -> ()], [Concat__20:0 -> (4)], 
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:141: Registering layer: Resize__21 for ONNX node: Resize__21
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:116: Registering tensor: Resize__21:0 for ONNX tensor: Resize__21:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:179: Resize__21 [Resize] outputs: [Resize__21:0 -> (-1, -1, -1, -1)], 
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Preprocessor/ResizeImage/resize/Squeeze [Squeeze]
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: Resize__21:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Preprocessor/ResizeImage/resize/Squeeze [Squeeze] inputs: [Resize__21:0 -> (-1, -1, -1, -1)], 
[08/16/2021-04:50:08] [V] [TRT] onnx2trt_utils.cpp:1641: Original shape: (_, _, _, _), squeezing to: (_, _, _)
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Preprocessor/ResizeImage/resize/Squeeze for ONNX node: StatefulPartitionedCall/Preprocessor/ResizeImage/resize/Squeeze
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Preprocessor/ResizeImage/resize/Squeeze:0 for ONNX tensor: StatefulPartitionedCall/Preprocessor/ResizeImage/resize/Squeeze:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Preprocessor/ResizeImage/resize/Squeeze [Squeeze] outputs: [StatefulPartitionedCall/Preprocessor/ResizeImage/resize/Squeeze:0 -> (-1, -1, -1)], 
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Preprocessor/stack [Unsqueeze]
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Preprocessor/ResizeImage/resize/Squeeze:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Preprocessor/stack [Unsqueeze] inputs: [StatefulPartitionedCall/Preprocessor/ResizeImage/resize/Squeeze:0 -> (-1, -1, -1)], 
[08/16/2021-04:50:08] [V] [TRT] onnx2trt_utils.cpp:1793: Original shape: (_, _, _), unsqueezing to: (_, _, _, _)
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Preprocessor/stack for ONNX node: StatefulPartitionedCall/Preprocessor/stack
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Preprocessor/stack:0 for ONNX tensor: StatefulPartitionedCall/Preprocessor/stack:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Preprocessor/stack [Unsqueeze] outputs: [StatefulPartitionedCall/Preprocessor/stack:0 -> (-1, -1, -1, -1)], 
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D__9 [Reshape]
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Preprocessor/stack:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: new_shape__809
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D__9 [Reshape] inputs: [StatefulPartitionedCall/Preprocessor/stack:0 -> (-1, -1, -1, -1)], [new_shape__809 -> (4)], 
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D__9 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D__9
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D__9:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D__9:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D__9 [Reshape] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D__9:0 -> (1, 3, 1024, 1024)], 
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D [Conv]
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D__9:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D__9:0 -> (1, 3, 1024, 1024)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D_weights_fused_bn -> (64, 3, 7, 7)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D_bias_fused_bn -> (64)], 
[08/16/2021-04:50:08] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 3, 1024, 1024)
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D
[08/16/2021-04:50:08] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (7, 7), strides: (2, 2), prepadding: (3, 3), postpadding: (3, 3), dilations: (1, 1), numOutputs: 64
[08/16/2021-04:50:08] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 512, 512)
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_bn/FusedBatchNormV3:0 -> (1, 64, 512, 512)], 
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 [Clip]
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:08] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_bn/FusedBatchNormV3:0 -> (1, 64, 512, 512)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6
[08/16/2021-04:50:08] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6:0 -> (1, 64, 512, 512)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool [MaxPool]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool [MaxPool] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6:0 -> (1, 64, 512, 512)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool [MaxPool] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool:0 -> (1, 64, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool:0 -> (1, 64, 256, 256)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D_weights_fused_bn -> (64, 64, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D_bias_fused_bn -> (64)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_bn/FusedBatchNormV3:0 -> (1, 64, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool:0 -> (1, 64, 256, 256)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D_weights_fused_bn -> (256, 64, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_bn/FusedBatchNormV3:0 -> (1, 256, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_bn/FusedBatchNormV3:0 -> (1, 64, 256, 256)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6:0 -> (1, 64, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6:0 -> (1, 64, 256, 256)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D_weights_fused_bn -> (64, 64, 3, 3)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D_bias_fused_bn -> (64)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_bn/FusedBatchNormV3:0 -> (1, 64, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_bn/FusedBatchNormV3:0 -> (1, 64, 256, 256)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6:0 -> (1, 64, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6:0 -> (1, 64, 256, 256)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D_weights_fused_bn -> (256, 64, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_bn/FusedBatchNormV3:0 -> (1, 256, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_bn/FusedBatchNormV3:0 -> (1, 256, 256, 256)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_bn/FusedBatchNormV3:0 -> (1, 256, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add:0 -> (1, 256, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add:0 -> (1, 256, 256, 256)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6:0 -> (1, 256, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6:0 -> (1, 256, 256, 256)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D_weights_fused_bn -> (64, 256, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D_bias_fused_bn -> (64)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_bn/FusedBatchNormV3:0 -> (1, 64, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_bn/FusedBatchNormV3:0 -> (1, 64, 256, 256)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6:0 -> (1, 64, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6:0 -> (1, 64, 256, 256)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_conv/Conv2D_weights_fused_bn -> (64, 64, 3, 3)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_conv/Conv2D_bias_fused_bn -> (64)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_bn/FusedBatchNormV3:0 -> (1, 64, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_bn/FusedBatchNormV3:0 -> (1, 64, 256, 256)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_relu/Relu6:0 -> (1, 64, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_relu/Relu6:0 -> (1, 64, 256, 256)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_conv/Conv2D_weights_fused_bn -> (256, 64, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_conv/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_bn/FusedBatchNormV3:0 -> (1, 256, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_add/add [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6:0 -> (1, 256, 256, 256)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_bn/FusedBatchNormV3:0 -> (1, 256, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_add/add for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_add/add
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_add/add:0 -> (1, 256, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_out/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_out/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_add/add:0 -> (1, 256, 256, 256)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_out/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_out/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_out/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_out/Relu6:0 -> (1, 256, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_out/Relu6:0 -> (1, 256, 256, 256)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_conv/Conv2D_weights_fused_bn -> (64, 256, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_conv/Conv2D_bias_fused_bn -> (64)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_bn/FusedBatchNormV3:0 -> (1, 64, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_bn/FusedBatchNormV3:0 -> (1, 64, 256, 256)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_relu/Relu6:0 -> (1, 64, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_relu/Relu6:0 -> (1, 64, 256, 256)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_conv/Conv2D_weights_fused_bn -> (64, 64, 3, 3)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_conv/Conv2D_bias_fused_bn -> (64)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_bn/FusedBatchNormV3:0 -> (1, 64, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_bn/FusedBatchNormV3:0 -> (1, 64, 256, 256)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_relu/Relu6:0 -> (1, 64, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_relu/Relu6:0 -> (1, 64, 256, 256)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_conv/Conv2D_weights_fused_bn -> (256, 64, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_conv/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_bn/FusedBatchNormV3:0 -> (1, 256, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_add/add [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_out/Relu6:0 -> (1, 256, 256, 256)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_bn/FusedBatchNormV3:0 -> (1, 256, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_add/add for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_add/add
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_add/add:0 -> (1, 256, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_out/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_out/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_add/add:0 -> (1, 256, 256, 256)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_out/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_out/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_out/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_out/Relu6:0 -> (1, 256, 256, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_out/Relu6:0 -> (1, 256, 256, 256)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D_weights_fused_bn -> (128, 256, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D_bias_fused_bn -> (128)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 128, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_bn/FusedBatchNormV3:0 -> (1, 128, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_out/Relu6:0 -> (1, 256, 256, 256)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D_weights_fused_bn -> (512, 256, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D_bias_fused_bn -> (512)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 256, 256)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 512, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_bn/FusedBatchNormV3:0 -> (1, 512, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_bn/FusedBatchNormV3:0 -> (1, 128, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6:0 -> (1, 128, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6:0 -> (1, 128, 128, 128)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D_weights_fused_bn -> (128, 128, 3, 3)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D_bias_fused_bn -> (128)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 128, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 128, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_bn/FusedBatchNormV3:0 -> (1, 128, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_bn/FusedBatchNormV3:0 -> (1, 128, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6:0 -> (1, 128, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6:0 -> (1, 128, 128, 128)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D_weights_fused_bn -> (512, 128, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D_bias_fused_bn -> (512)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 128, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 512, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_bn/FusedBatchNormV3:0 -> (1, 512, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_bn/FusedBatchNormV3:0 -> (1, 512, 128, 128)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_bn/FusedBatchNormV3:0 -> (1, 512, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add:0 -> (1, 512, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add:0 -> (1, 512, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6:0 -> (1, 512, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6:0 -> (1, 512, 128, 128)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D_weights_fused_bn -> (128, 512, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D_bias_fused_bn -> (128)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 512, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 128, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_bn/FusedBatchNormV3:0 -> (1, 128, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_bn/FusedBatchNormV3:0 -> (1, 128, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6:0 -> (1, 128, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6:0 -> (1, 128, 128, 128)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_conv/Conv2D_weights_fused_bn -> (128, 128, 3, 3)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_conv/Conv2D_bias_fused_bn -> (128)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 128, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 128, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_bn/FusedBatchNormV3:0 -> (1, 128, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_bn/FusedBatchNormV3:0 -> (1, 128, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_relu/Relu6:0 -> (1, 128, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_relu/Relu6:0 -> (1, 128, 128, 128)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D_weights_fused_bn -> (512, 128, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D_bias_fused_bn -> (512)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 128, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 512, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_bn/FusedBatchNormV3:0 -> (1, 512, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6:0 -> (1, 512, 128, 128)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_bn/FusedBatchNormV3:0 -> (1, 512, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add:0 -> (1, 512, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add:0 -> (1, 512, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6:0 -> (1, 512, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6:0 -> (1, 512, 128, 128)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_conv/Conv2D_weights_fused_bn -> (128, 512, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_conv/Conv2D_bias_fused_bn -> (128)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 512, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 128, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_bn/FusedBatchNormV3:0 -> (1, 128, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_bn/FusedBatchNormV3:0 -> (1, 128, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_relu/Relu6:0 -> (1, 128, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_relu/Relu6:0 -> (1, 128, 128, 128)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_conv/Conv2D_weights_fused_bn -> (128, 128, 3, 3)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_conv/Conv2D_bias_fused_bn -> (128)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 128, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 128, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_bn/FusedBatchNormV3:0 -> (1, 128, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_bn/FusedBatchNormV3:0 -> (1, 128, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_relu/Relu6:0 -> (1, 128, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_relu/Relu6:0 -> (1, 128, 128, 128)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_conv/Conv2D_weights_fused_bn -> (512, 128, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_conv/Conv2D_bias_fused_bn -> (512)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 128, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 512, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_bn/FusedBatchNormV3:0 -> (1, 512, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_add/add [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6:0 -> (1, 512, 128, 128)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_bn/FusedBatchNormV3:0 -> (1, 512, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_add/add for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_add/add
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_add/add:0 -> (1, 512, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_out/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_out/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_add/add:0 -> (1, 512, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_out/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_out/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_out/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_out/Relu6:0 -> (1, 512, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_out/Relu6:0 -> (1, 512, 128, 128)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_conv/Conv2D_weights_fused_bn -> (128, 512, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_conv/Conv2D_bias_fused_bn -> (128)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 512, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 128, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_bn/FusedBatchNormV3:0 -> (1, 128, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_bn/FusedBatchNormV3:0 -> (1, 128, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_relu/Relu6:0 -> (1, 128, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_relu/Relu6:0 -> (1, 128, 128, 128)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_conv/Conv2D_weights_fused_bn -> (128, 128, 3, 3)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_conv/Conv2D_bias_fused_bn -> (128)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 128, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 128, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_bn/FusedBatchNormV3:0 -> (1, 128, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_bn/FusedBatchNormV3:0 -> (1, 128, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_relu/Relu6:0 -> (1, 128, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_relu/Relu6:0 -> (1, 128, 128, 128)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_conv/Conv2D_weights_fused_bn -> (512, 128, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_conv/Conv2D_bias_fused_bn -> (512)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 128, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 512, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_bn/FusedBatchNormV3:0 -> (1, 512, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_add/add [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_out/Relu6:0 -> (1, 512, 128, 128)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_bn/FusedBatchNormV3:0 -> (1, 512, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_add/add for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_add/add
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_add/add:0 -> (1, 512, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_out/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_out/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_add/add:0 -> (1, 512, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_out/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_out/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_out/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_out/Relu6:0 -> (1, 512, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_out/Relu6:0 -> (1, 512, 128, 128)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D_weights_fused_bn -> (256, 512, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 512, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_out/Relu6:0 -> (1, 512, 128, 128)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D_weights_fused_bn -> (1024, 512, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D_bias_fused_bn -> (1024)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 512, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 1024, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_bn/FusedBatchNormV3:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/Conv2D/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_out/Relu6:0 -> (1, 512, 128, 128)], [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/Conv2D/ReadVariableOp:0 -> (256, 512, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd/ReadVariableOp:0 -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 512, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D_weights_fused_bn -> (1024, 256, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D_bias_fused_bn -> (1024)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 1024, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_bn/FusedBatchNormV3:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_bn/FusedBatchNormV3:0 -> (1, 1024, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_bn/FusedBatchNormV3:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add:0 -> (1, 1024, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6:0 -> (1, 1024, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D_weights_fused_bn -> (256, 1024, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1024, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_conv/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_conv/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_relu/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_relu/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D_weights_fused_bn -> (1024, 256, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D_bias_fused_bn -> (1024)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 1024, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_bn/FusedBatchNormV3:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6:0 -> (1, 1024, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_bn/FusedBatchNormV3:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add:0 -> (1, 1024, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6:0 -> (1, 1024, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_conv/Conv2D_weights_fused_bn -> (256, 1024, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_conv/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1024, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_relu/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_relu/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_conv/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_conv/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_relu/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_relu/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_conv/Conv2D_weights_fused_bn -> (1024, 256, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_conv/Conv2D_bias_fused_bn -> (1024)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 1024, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_bn/FusedBatchNormV3:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_add/add [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6:0 -> (1, 1024, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_bn/FusedBatchNormV3:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_add/add for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_add/add
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_add/add:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_out/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_out/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_add/add:0 -> (1, 1024, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_out/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_out/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_out/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_out/Relu6:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_out/Relu6:0 -> (1, 1024, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_conv/Conv2D_weights_fused_bn -> (256, 1024, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_conv/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1024, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_relu/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_relu/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_conv/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_conv/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_relu/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_relu/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_conv/Conv2D_weights_fused_bn -> (1024, 256, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_conv/Conv2D_bias_fused_bn -> (1024)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 1024, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_bn/FusedBatchNormV3:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_add/add [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_out/Relu6:0 -> (1, 1024, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_bn/FusedBatchNormV3:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_add/add for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_add/add
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_add/add:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_out/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_out/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_add/add:0 -> (1, 1024, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_out/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_out/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_out/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_out/Relu6:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_out/Relu6:0 -> (1, 1024, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_conv/Conv2D_weights_fused_bn -> (256, 1024, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_conv/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1024, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_relu/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_relu/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_conv/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_conv/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_relu/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_relu/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_conv/Conv2D_weights_fused_bn -> (1024, 256, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_conv/Conv2D_bias_fused_bn -> (1024)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 1024, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_bn/FusedBatchNormV3:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_add/add [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_out/Relu6:0 -> (1, 1024, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_bn/FusedBatchNormV3:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_add/add for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_add/add
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_add/add:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_out/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_out/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_add/add:0 -> (1, 1024, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_out/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_out/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_out/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_out/Relu6:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_out/Relu6:0 -> (1, 1024, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_conv/Conv2D_weights_fused_bn -> (256, 1024, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_conv/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1024, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_relu/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_relu/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_conv/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_conv/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_bn/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_relu/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_relu/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_conv/Conv2D_weights_fused_bn -> (1024, 256, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_conv/Conv2D_bias_fused_bn -> (1024)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 1024, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_bn/FusedBatchNormV3:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_add/add [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_out/Relu6:0 -> (1, 1024, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_bn/FusedBatchNormV3:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_add/add for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_add/add
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_add/add:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_out/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_out/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_add/add:0 -> (1, 1024, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_out/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_out/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_out/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_out/Relu6:0 -> (1, 1024, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_out/Relu6:0 -> (1, 1024, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D_weights_fused_bn -> (512, 1024, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D_bias_fused_bn -> (512)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1024, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 512, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_bn/FusedBatchNormV3:0 -> (1, 512, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_out/Relu6:0 -> (1, 1024, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D_weights_fused_bn -> (2048, 1024, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D_bias_fused_bn -> (2048)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1024, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2048
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 2048, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_bn/FusedBatchNormV3:0 -> (1, 2048, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/Conv2D/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_out/Relu6:0 -> (1, 1024, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/Conv2D/ReadVariableOp:0 -> (256, 1024, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd/ReadVariableOp:0 -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1024, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_bn/FusedBatchNormV3:0 -> (1, 512, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6:0 -> (1, 512, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6:0 -> (1, 512, 32, 32)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D_weights_fused_bn -> (512, 512, 3, 3)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D_bias_fused_bn -> (512)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 512, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 512, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_bn/FusedBatchNormV3:0 -> (1, 512, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_bn/FusedBatchNormV3:0 -> (1, 512, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6:0 -> (1, 512, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6:0 -> (1, 512, 32, 32)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D_weights_fused_bn -> (2048, 512, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D_bias_fused_bn -> (2048)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 512, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2048
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 2048, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_bn/FusedBatchNormV3:0 -> (1, 2048, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_bn/FusedBatchNormV3:0 -> (1, 2048, 32, 32)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_bn/FusedBatchNormV3:0 -> (1, 2048, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add:0 -> (1, 2048, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add:0 -> (1, 2048, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6:0 -> (1, 2048, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6:0 -> (1, 2048, 32, 32)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D_weights_fused_bn -> (512, 2048, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D_bias_fused_bn -> (512)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 2048, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 512, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_bn/FusedBatchNormV3:0 -> (1, 512, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_bn/FusedBatchNormV3:0 -> (1, 512, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6:0 -> (1, 512, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6:0 -> (1, 512, 32, 32)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_conv/Conv2D_weights_fused_bn -> (512, 512, 3, 3)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_conv/Conv2D_bias_fused_bn -> (512)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 512, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 512, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_bn/FusedBatchNormV3:0 -> (1, 512, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_bn/FusedBatchNormV3:0 -> (1, 512, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_relu/Relu6:0 -> (1, 512, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_relu/Relu6:0 -> (1, 512, 32, 32)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D_weights_fused_bn -> (2048, 512, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D_bias_fused_bn -> (2048)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 512, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2048
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 2048, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_bn/FusedBatchNormV3:0 -> (1, 2048, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6:0 -> (1, 2048, 32, 32)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_bn/FusedBatchNormV3:0 -> (1, 2048, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add:0 -> (1, 2048, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add:0 -> (1, 2048, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6:0 -> (1, 2048, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6:0 -> (1, 2048, 32, 32)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_conv/Conv2D_weights_fused_bn -> (512, 2048, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_conv/Conv2D_bias_fused_bn -> (512)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 2048, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 512, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_bn/FusedBatchNormV3:0 -> (1, 512, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_bn/FusedBatchNormV3:0 -> (1, 512, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_relu/Relu6:0 -> (1, 512, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_relu/Relu6:0 -> (1, 512, 32, 32)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_conv/Conv2D_weights_fused_bn -> (512, 512, 3, 3)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_conv/Conv2D_bias_fused_bn -> (512)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 512, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 512, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_bn/FusedBatchNormV3:0 -> (1, 512, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_relu/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_bn/FusedBatchNormV3:0 -> (1, 512, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_relu/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_relu/Relu6:0 -> (1, 512, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_relu/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_relu/Relu6:0 -> (1, 512, 32, 32)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_conv/Conv2D_weights_fused_bn -> (2048, 512, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_conv/Conv2D_bias_fused_bn -> (2048)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 512, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2048
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 2048, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_bn/FusedBatchNormV3:0 -> (1, 2048, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_add/add [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_bn/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6:0 -> (1, 2048, 32, 32)], [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_bn/FusedBatchNormV3:0 -> (1, 2048, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_add/add for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_add/add
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_add/add:0 -> (1, 2048, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_out/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_add/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_out/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_add/add:0 -> (1, 2048, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_out/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_out/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_out/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_out/Relu6:0 -> (1, 2048, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_out/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/Conv2D/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_out/Relu6:0 -> (1, 2048, 32, 32)], [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/Conv2D/ReadVariableOp:0 -> (256, 2048, 1, 1)], [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd/ReadVariableOp:0 -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 2048, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd:0 -> (1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1/ReadVariableOp:0 -> (256, 256, 3, 3)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2:0 -> (1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1/ReadVariableOp:0 -> (256, 256, 3, 3)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2:0 -> (1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D/ReadVariableOp:0 -> (256, 256, 3, 3)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (0, 0), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D:0 -> (1, 256, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508 [Unsqueeze]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508 [Unsqueeze] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd:0 -> (1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] onnx2trt_utils.cpp:1793: Original shape: (1, 256, 32, 32), unsqueezing to: (1, 1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508 [Unsqueeze] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 -> (1, 1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 [BatchNormalization]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/ReadVariableOp_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/ReadVariableOp:0 -> (256)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/ReadVariableOp_1:0 -> (256)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0 -> (256)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0 -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 [BatchNormalization]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/ReadVariableOp_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/ReadVariableOp:0 -> (256)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/ReadVariableOp_1:0 -> (256)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0 -> (256)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0 -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/FusedBatchNormV3 [BatchNormalization]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/ReadVariableOp_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/FusedBatchNormV3/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/FusedBatchNormV3/ReadVariableOp_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/ReadVariableOp:0 -> (256)], [StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/ReadVariableOp_1:0 -> (256)], [StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/FusedBatchNormV3/ReadVariableOp:0 -> (256)], [StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/FusedBatchNormV3/ReadVariableOp_1:0 -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/FusedBatchNormV3
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/FusedBatchNormV3:0 -> (1, 256, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Concat__510 [Concat]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Concat__510 [Concat] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 -> (1, 1, 256, 32, 32)], [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 -> (1, 1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Concat__510 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Concat__510
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Concat__510:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Concat__510:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Concat__510 [Concat] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Concat__510:0 -> (1, 2, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6:0 -> (1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6:0 -> (1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/FusedBatchNormV3:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6:0 -> (1, 256, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512 [Unsqueeze]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Concat__510:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512 [Unsqueeze] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Concat__510:0 -> (1, 2, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] onnx2trt_utils.cpp:1793: Original shape: (1, 2, 256, 32, 32), unsqueezing to: (1, 2, 256, 32, 1, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512 [Unsqueeze] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 -> (1, 2, 256, 32, 1, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_2 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_2_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_2_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_2 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_2_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_2_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_2 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_2
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_2 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 256, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 256, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (0, 0), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_batchnorm/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_batchnorm/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_batchnorm/FusedBatchNormV3:0 -> (1, 256, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Concat__513 [Concat]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Concat__513 [Concat] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 -> (1, 2, 256, 32, 1, 32)], [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 -> (1, 2, 256, 32, 1, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Concat__513 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Concat__513
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Concat__513:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Concat__513:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Concat__513 [Concat] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Concat__513:0 -> (1, 2, 256, 32, 2, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6:0 -> (1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_2/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_2/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_2/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_2/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_2/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_2/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_2/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_2/Relu6:0 -> (1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6:0 -> (1, 256, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6:0 -> (1, 256, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_batchnorm/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_batchnorm/FusedBatchNormV3:0 -> (1, 256, 8, 8)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6:0 -> (1, 256, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose__786 [Transpose]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Concat__513:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: Transpose__786 [Transpose] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Concat__513:0 -> (1, 2, 256, 32, 2, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: Transpose__786 for ONNX node: Transpose__786
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: Transpose__786:0 for ONNX tensor: Transpose__786:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: Transpose__786 [Transpose] outputs: [Transpose__786:0 -> (1, 32, 2, 32, 2, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_2 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_2_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_2_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_2 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_2_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_2_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_2 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_2
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_2 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_2/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_2/Relu6:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 256, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_3 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_3_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_3_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_3 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_3_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_3_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_3
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_3 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 256, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6:0 -> (1, 256, 8, 8)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 256, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6:0 -> (1, 256, 8, 8)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 256, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape [Reshape]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: Transpose__786:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__807
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape [Reshape] inputs: [Transpose__786:0 -> (1, 32, 2, 32, 2, 256)], [const_fold_opt__807 -> (4)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape [Reshape] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape:0 -> (1, 64, 64, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_2/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_2/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_2/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_2/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_2/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_2/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_2/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_2/Relu6:0 -> (1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6:0 -> (1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6:0 -> (1, 256, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_3/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_3/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_3/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_3/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_3/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_3/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_3/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_3/Relu6:0 -> (1, 256, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 256, 8, 8)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6:0 -> (1, 256, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 256, 8, 8)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6:0 -> (1, 256, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose__732 [Transpose]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: Transpose__732 [Transpose] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape:0 -> (1, 64, 64, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: Transpose__732 for ONNX node: Transpose__732
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: Transpose__732:0 for ONNX tensor: Transpose__732:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: Transpose__732 [Transpose] outputs: [Transpose__732:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_2 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_2/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_2_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_2_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_2 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_2/Relu6:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_2_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_2_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_2 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_2
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_2 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_2 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_2_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_2_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_2 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_2_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_2_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_2 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_2
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_2 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_3 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_3_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_3_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_3 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_3_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_3_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_3
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_3 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 256, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_3/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_3/Relu6:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 256, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6:0 -> (1, 256, 8, 8)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 256, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_4 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_4_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_4_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_4 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6:0 -> (1, 256, 8, 8)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_4_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_4_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_4 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_4
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_4 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 256, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: Transpose__732:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add [Add] inputs: [Transpose__732:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add [Add] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_2/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_2/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_2/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_2/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_2/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_2/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_2/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_2/Relu6:0 -> (1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_2/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_2/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_2/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_2/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_2/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_2/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_2/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_2/Relu6:0 -> (1, 256, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_3/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_3/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_3/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_3/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_3/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_3/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_3/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_3/Relu6:0 -> (1, 256, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6:0 -> (1, 256, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 256, 8, 8)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6:0 -> (1, 256, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_4/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_4/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 256, 8, 8)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_4/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_4/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_4/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_4/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_4/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_4/Relu6:0 -> (1, 256, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_conv/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_conv/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_2/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/Conv2D_2/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_2/Relu6:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/Conv2D_2/ReadVariableOp:0 -> (546, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3/ReadVariableOp:0 -> (546)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 546
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 546, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2:0 -> (1, 546, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_2/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/Conv2D_4/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_2/Relu6:0 -> (1, 256, 32, 32)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/Conv2D_4/ReadVariableOp:0 -> (24, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4/ReadVariableOp:0 -> (24)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 24
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 24, 32, 32)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2:0 -> (1, 24, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_3 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_3/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_3_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_3_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_3 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_3/Relu6:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_3_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_3_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_3
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_3 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 256, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_3 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_3_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_3_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_3 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_3_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_3_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_3
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_3 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 256, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_4 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_4_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_4_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_4 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6:0 -> (1, 256, 8, 8)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_4_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_4_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_4 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_4
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_4 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 256, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_4/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_4/Relu6:0 -> (1, 256, 8, 8)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 256, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__359 [Transpose]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__359 [Transpose] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2:0 -> (1, 546, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__359 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__359
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__359:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__359:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__359 [Transpose] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__359:0 -> (1, 32, 32, 546)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__386 [Transpose]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__386 [Transpose] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2:0 -> (1, 24, 32, 32)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__386 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__386
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__386:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__386:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__386 [Transpose] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__386:0 -> (1, 32, 32, 24)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_3/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_3/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_3/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_3/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_3/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_3/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_3/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_3/Relu6:0 -> (1, 256, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_3/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_3/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_3/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_3/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_3/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_3/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_3/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_3/Relu6:0 -> (1, 256, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_4/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_4/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 256, 8, 8)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_4/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_4/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_4/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_4/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_4/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_4/Relu6:0 -> (1, 256, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 256, 8, 8)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6:0 -> (1, 256, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577 [Unsqueeze]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577 [Unsqueeze] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] onnx2trt_utils.cpp:1793: Original shape: (1, 256, 64, 64), unsqueezing to: (1, 1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577 [Unsqueeze] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 -> (1, 1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2 [Reshape]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__359:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__802
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__359:0 -> (1, 32, 32, 546)], [const_fold_opt__802 -> (3)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2:0 -> (1, 6144, 91)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 [Reshape]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__386:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__797
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__386:0 -> (1, 32, 32, 24)], [const_fold_opt__797 -> (3)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 -> (1, 6144, 4)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_3/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/Conv2D_2/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_3/Relu6:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/Conv2D_2/ReadVariableOp:0 -> (546, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3/ReadVariableOp:0 -> (546)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 546
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 546, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3:0 -> (1, 546, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_3/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/Conv2D_4/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_3/Relu6:0 -> (1, 256, 16, 16)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/Conv2D_4/ReadVariableOp:0 -> (24, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4/ReadVariableOp:0 -> (24)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 24
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 24, 16, 16)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3:0 -> (1, 24, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_4 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_4/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_4_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_4_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_4 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_4/Relu6:0 -> (1, 256, 8, 8)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_4_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_4_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_4 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_4
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_4 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 256, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_4 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_4_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_4_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_4 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6:0 -> (1, 256, 8, 8)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_4_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_4_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_4 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_4
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_4 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 256, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Concat__579 [Concat]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Concat__579 [Concat] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 -> (1, 1, 256, 64, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 -> (1, 1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Concat__579 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Concat__579
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Concat__579:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Concat__579:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Concat__579 [Concat] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Concat__579:0 -> (1, 2, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__419 [Transpose]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__419 [Transpose] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3:0 -> (1, 546, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__419 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__419
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__419:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__419:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__419 [Transpose] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__419:0 -> (1, 16, 16, 546)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__446 [Transpose]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__446 [Transpose] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3:0 -> (1, 24, 16, 16)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__446 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__446
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__446:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__446:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__446 [Transpose] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__446:0 -> (1, 16, 16, 24)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_4/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_4/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 256, 8, 8)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_4/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_4/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_4/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_4/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_4/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_4/Relu6:0 -> (1, 256, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_4/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_4/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 256, 8, 8)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_4/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_4/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_4/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_4/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_4/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_4/Relu6:0 -> (1, 256, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_1 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_1_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_1_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_1 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_1_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_1_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_1 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_1
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_1 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581 [Unsqueeze]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Concat__579:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581 [Unsqueeze] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Concat__579:0 -> (1, 2, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] onnx2trt_utils.cpp:1793: Original shape: (1, 2, 256, 64, 64), unsqueezing to: (1, 2, 256, 64, 1, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581 [Unsqueeze] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 -> (1, 2, 256, 64, 1, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 [Reshape]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__419:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__802
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__419:0 -> (1, 16, 16, 546)], [const_fold_opt__802 -> (3)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 -> (1, 1536, 91)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 [Reshape]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__446:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__797
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__446:0 -> (1, 16, 16, 24)], [const_fold_opt__797 -> (3)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 -> (1, 1536, 4)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_4/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/Conv2D_2/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_4/Relu6:0 -> (1, 256, 8, 8)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/Conv2D_2/ReadVariableOp:0 -> (546, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3/ReadVariableOp:0 -> (546)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 546
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 546, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4:0 -> (1, 546, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_4/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/Conv2D_4/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_4/Relu6:0 -> (1, 256, 8, 8)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/Conv2D_4/ReadVariableOp:0 -> (24, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4/ReadVariableOp:0 -> (24)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 24
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 24, 8, 8)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4:0 -> (1, 24, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_1/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_1/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_1/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_1/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_1/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_1/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_1/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_1/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Concat__582 [Concat]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Concat__582 [Concat] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 -> (1, 2, 256, 64, 1, 64)], [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 -> (1, 2, 256, 64, 1, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Concat__582 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Concat__582
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Concat__582:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Concat__582:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Concat__582 [Concat] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Concat__582:0 -> (1, 2, 256, 64, 2, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__479 [Transpose]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__479 [Transpose] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4:0 -> (1, 546, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__479 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__479
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__479:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__479:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__479 [Transpose] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__479:0 -> (1, 8, 8, 546)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__506 [Transpose]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__506 [Transpose] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4:0 -> (1, 24, 8, 8)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__506 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__506
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__506:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__506:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__506 [Transpose] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__506:0 -> (1, 8, 8, 24)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_1 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_1_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_1_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_1 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_1_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_1_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_1 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_1
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_1 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_1 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_1/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_1_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_1_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_1 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_1/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_1_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_1_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_1 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_1
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_1 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose__788 [Transpose]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Concat__582:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: Transpose__788 [Transpose] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Concat__582:0 -> (1, 2, 256, 64, 2, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: Transpose__788 for ONNX node: Transpose__788
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: Transpose__788:0 for ONNX tensor: Transpose__788:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: Transpose__788 [Transpose] outputs: [Transpose__788:0 -> (1, 64, 2, 64, 2, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4 [Reshape]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__479:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__802
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__479:0 -> (1, 8, 8, 546)], [const_fold_opt__802 -> (3)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4:0 -> (1, 384, 91)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 [Reshape]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__506:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__797
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__506:0 -> (1, 8, 8, 24)], [const_fold_opt__797 -> (3)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 -> (1, 384, 4)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_1/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_1/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_1/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_1/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_1/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_1/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_1/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_1/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_1/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_1/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_1/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_1/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_1/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_1/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_1/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_1/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape [Reshape]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: Transpose__788:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__806
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape [Reshape] inputs: [Transpose__788:0 -> (1, 64, 2, 64, 2, 256)], [const_fold_opt__806 -> (4)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape [Reshape] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape:0 -> (1, 128, 128, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_1 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_1/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_1_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_1_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_1 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_1/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_1_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_1_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_1 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_1
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_1 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_1 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_1/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_1_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_1_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_1 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_1/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_1_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_1_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_1 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_1
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_1 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose__738 [Transpose]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: Transpose__738 [Transpose] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape:0 -> (1, 128, 128, 256)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: Transpose__738 for ONNX node: Transpose__738
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: Transpose__738:0 for ONNX tensor: Transpose__738:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: Transpose__738 [Transpose] outputs: [Transpose__738:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_1/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_1/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_1/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_1/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_1/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_1/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_1/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_1/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_1/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_1/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_1/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_1/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_1/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_1/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_1/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_1/Relu6:0 -> (1, 256, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: Transpose__738:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 [Add] inputs: [Transpose__738:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 [Add] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_1/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/Conv2D_2/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_1/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/Conv2D_2/ReadVariableOp:0 -> (546, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3/ReadVariableOp:0 -> (546)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 546
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 546, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1:0 -> (1, 546, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_1/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/Conv2D_4/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_1/Relu6:0 -> (1, 256, 64, 64)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/Conv2D_4/ReadVariableOp:0 -> (24, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4/ReadVariableOp:0 -> (24)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 24
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 24, 64, 64)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1:0 -> (1, 24, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__548 [Transpose]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__548 [Transpose] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1:0 -> (1, 546, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__548 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__548
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__548:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__548:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__548 [Transpose] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__548:0 -> (1, 64, 64, 546)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__575 [Transpose]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__575 [Transpose] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1:0 -> (1, 24, 64, 64)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__575 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__575
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__575:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__575:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__575 [Transpose] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__575:0 -> (1, 64, 64, 24)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 [Clip] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 for ONNX node: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 [Clip] outputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 [Reshape]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__548:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__802
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__548:0 -> (1, 64, 64, 546)], [const_fold_opt__802 -> (3)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 -> (1, 24576, 91)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 [Reshape]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__575:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__797
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__575:0 -> (1, 64, 64, 24)], [const_fold_opt__797 -> (3)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 -> (1, 24576, 4)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_0/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_0/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_0/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_0/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_0/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_0/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_0/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_0/Relu6:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_0/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_0/Relu6:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_0/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_0/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_0/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_0/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_0/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_0/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_0/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_0/Relu6:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_0/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_0/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_0/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_0/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_0/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_0/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_0/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_0/Relu6:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_0/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_0/Relu6:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_0/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_weights_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_bias_fused_bn
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_0/Relu6:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_bias_fused_bn -> (256)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_0/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_0/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_0/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_0/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_0/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_0/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_0/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_0/Relu6:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_0/Relu6 [Clip]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_0/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6_min__377 -> ()], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6_max__555 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_0/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_0/Relu6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_0/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_0/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_0/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_0/Relu6:0 -> (1, 256, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_0/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/Conv2D_2/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_0/Relu6:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/Conv2D_2/ReadVariableOp:0 -> (546, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3/ReadVariableOp:0 -> (546)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 546
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 546, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd:0 -> (1, 546, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd [Conv]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_0/Relu6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/Conv2D_4/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4/ReadVariableOp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_0/Relu6:0 -> (1, 256, 128, 128)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/Conv2D_4/ReadVariableOp:0 -> (24, 256, 3, 3)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4/ReadVariableOp:0 -> (24)], 
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 256, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 24
[08/16/2021-04:50:09] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 24, 128, 128)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd:0 -> (1, 24, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__617 [Transpose]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__617 [Transpose] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd:0 -> (1, 546, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__617 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__617
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__617:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__617:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__617 [Transpose] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__617:0 -> (1, 128, 128, 546)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__644 [Transpose]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__644 [Transpose] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd:0 -> (1, 24, 128, 128)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__644 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__644
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__644:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__644:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__644 [Transpose] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__644:0 -> (1, 128, 128, 24)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape [Reshape]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__617:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__802
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__617:0 -> (1, 128, 128, 546)], [const_fold_opt__802 -> (3)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape:0 -> (1, 98304, 91)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape [Reshape]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__644:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__797
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__644:0 -> (1, 128, 128, 24)], [const_fold_opt__797 -> (3)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 -> (1, 98304, 4)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/concat_1 [Concat]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/concat_1 [Concat] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape:0 -> (1, 98304, 91)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 -> (1, 24576, 91)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2:0 -> (1, 6144, 91)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 -> (1, 1536, 91)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4:0 -> (1, 384, 91)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/concat_1 for ONNX node: StatefulPartitionedCall/concat_1
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/concat_1:0 for ONNX tensor: StatefulPartitionedCall/concat_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/concat_1 [Concat] outputs: [StatefulPartitionedCall/concat_1:0 -> (1, 130944, 91)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/concat [Concat]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/concat [Concat] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 -> (1, 98304, 4)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 -> (1, 24576, 4)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 -> (1, 6144, 4)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 -> (1, 1536, 4)], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 -> (1, 384, 4)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/concat for ONNX node: StatefulPartitionedCall/concat
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/concat:0 for ONNX tensor: StatefulPartitionedCall/concat:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/concat [Concat] outputs: [StatefulPartitionedCall/concat:0 -> (1, 130944, 4)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/convert_scores [Sigmoid]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/concat_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/convert_scores [Sigmoid] inputs: [StatefulPartitionedCall/concat_1:0 -> (1, 130944, 91)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/convert_scores for ONNX node: StatefulPartitionedCall/Postprocessor/convert_scores
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: Identity_7:0 for ONNX tensor: Identity_7:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/convert_scores [Sigmoid] outputs: [Identity_7:0 -> (1, 130944, 91)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Reshape_1 [Reshape]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/concat:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__792
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Reshape_1 [Reshape] inputs: [StatefulPartitionedCall/concat:0 -> (1, 130944, 4)], [const_fold_opt__792 -> (2)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Reshape_1 for ONNX node: StatefulPartitionedCall/Postprocessor/Reshape_1
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Reshape_1:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Reshape_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Reshape_1 [Reshape] outputs: [StatefulPartitionedCall/Postprocessor/Reshape_1:0 -> (130944, 4)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/transpose [Transpose]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Reshape_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/transpose [Transpose] inputs: [StatefulPartitionedCall/Postprocessor/Reshape_1:0 -> (130944, 4)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/transpose for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/transpose
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/transpose:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/transpose:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/transpose [Transpose] outputs: [StatefulPartitionedCall/Postprocessor/Decode/transpose:0 -> (4, 130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/unstack [Split]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/transpose:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/unstack [Split] inputs: [StatefulPartitionedCall/Postprocessor/Decode/transpose:0 -> (4, 130944)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/unstack for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/unstack
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/unstack for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/unstack
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/unstack for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/unstack
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/unstack for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/unstack
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/unstack:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/unstack:0
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/unstack:1 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/unstack:1
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/unstack:2 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/unstack:2
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/unstack:3 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/unstack:3
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/unstack [Split] outputs: [StatefulPartitionedCall/Postprocessor/Decode/unstack:0 -> (1, 130944)], [StatefulPartitionedCall/Postprocessor/Decode/unstack:1 -> (1, 130944)], [StatefulPartitionedCall/Postprocessor/Decode/unstack:2 -> (1, 130944)], [StatefulPartitionedCall/Postprocessor/Decode/unstack:3 -> (1, 130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/unstack__650 [Squeeze]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/unstack:3
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/unstack__650 [Squeeze] inputs: [StatefulPartitionedCall/Postprocessor/Decode/unstack:3 -> (1, 130944)], 
[08/16/2021-04:50:09] [V] [TRT] onnx2trt_utils.cpp:1641: Original shape: (1, 130944), squeezing to: (130944,)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/unstack__650 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/unstack__650
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/unstack__650:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/unstack__650:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/unstack__650 [Squeeze] outputs: [StatefulPartitionedCall/Postprocessor/Decode/unstack__650:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/unstack__649 [Squeeze]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/unstack:2
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/unstack__649 [Squeeze] inputs: [StatefulPartitionedCall/Postprocessor/Decode/unstack:2 -> (1, 130944)], 
[08/16/2021-04:50:09] [V] [TRT] onnx2trt_utils.cpp:1641: Original shape: (1, 130944), squeezing to: (130944,)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/unstack__649 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/unstack__649
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/unstack__649:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/unstack__649:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/unstack__649 [Squeeze] outputs: [StatefulPartitionedCall/Postprocessor/Decode/unstack__649:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/unstack__648 [Squeeze]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/unstack:1
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/unstack__648 [Squeeze] inputs: [StatefulPartitionedCall/Postprocessor/Decode/unstack:1 -> (1, 130944)], 
[08/16/2021-04:50:09] [V] [TRT] onnx2trt_utils.cpp:1641: Original shape: (1, 130944), squeezing to: (130944,)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/unstack__648 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/unstack__648
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/unstack__648:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/unstack__648:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/unstack__648 [Squeeze] outputs: [StatefulPartitionedCall/Postprocessor/Decode/unstack__648:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/unstack__647 [Squeeze]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/unstack:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/unstack__647 [Squeeze] inputs: [StatefulPartitionedCall/Postprocessor/Decode/unstack:0 -> (1, 130944)], 
[08/16/2021-04:50:09] [V] [TRT] onnx2trt_utils.cpp:1641: Original shape: (1, 130944), squeezing to: (130944,)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/unstack__647 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/unstack__647
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/unstack__647:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/unstack__647:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/unstack__647 [Squeeze] outputs: [StatefulPartitionedCall/Postprocessor/Decode/unstack__647:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/truediv_3 [Mul]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/unstack__650:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_2_recip:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/truediv_3 [Mul] inputs: [StatefulPartitionedCall/Postprocessor/Decode/unstack__650:0 -> (130944)], [ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_2_recip:0 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/truediv_3 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/truediv_3
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/truediv_3:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/truediv_3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/truediv_3 [Mul] outputs: [StatefulPartitionedCall/Postprocessor/Decode/truediv_3:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/truediv_2 [Mul]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/unstack__649:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_2_recip:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/truediv_2 [Mul] inputs: [StatefulPartitionedCall/Postprocessor/Decode/unstack__649:0 -> (130944)], [ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_2_recip:0 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/truediv_2 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/truediv_2
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/truediv_2:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/truediv_2:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/truediv_2 [Mul] outputs: [StatefulPartitionedCall/Postprocessor/Decode/truediv_2:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/truediv_1 [Mul]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/unstack__648:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_1_recip:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/truediv_1 [Mul] inputs: [StatefulPartitionedCall/Postprocessor/Decode/unstack__648:0 -> (130944)], [ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_1_recip:0 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/truediv_1 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/truediv_1
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/truediv_1:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/truediv_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/truediv_1 [Mul] outputs: [StatefulPartitionedCall/Postprocessor/Decode/truediv_1:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/truediv [Mul]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/unstack__647:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_1_recip:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/truediv [Mul] inputs: [StatefulPartitionedCall/Postprocessor/Decode/unstack__647:0 -> (130944)], [ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_1_recip:0 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/truediv for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/truediv
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/truediv:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/truediv:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/truediv [Mul] outputs: [StatefulPartitionedCall/Postprocessor/Decode/truediv:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/Exp [Exp]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/truediv_3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/Exp [Exp] inputs: [StatefulPartitionedCall/Postprocessor/Decode/truediv_3:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/Exp for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/Exp
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/Exp:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/Exp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/Exp [Exp] outputs: [StatefulPartitionedCall/Postprocessor/Decode/Exp:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/Exp_1 [Exp]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/truediv_2:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/Exp_1 [Exp] inputs: [StatefulPartitionedCall/Postprocessor/Decode/truediv_2:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/Exp_1 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/Exp_1
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/Exp_1:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/Exp_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/Exp_1 [Exp] outputs: [StatefulPartitionedCall/Postprocessor/Decode/Exp_1:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/mul_3 [Mul]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/truediv_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/sub:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/mul_3 [Mul] inputs: [StatefulPartitionedCall/Postprocessor/Decode/truediv_1:0 -> (130944)], [StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/sub:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/mul_3 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/mul_3
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/mul_3:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/mul_3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/mul_3 [Mul] outputs: [StatefulPartitionedCall/Postprocessor/Decode/mul_3:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/mul_2 [Mul]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/truediv:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/sub_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/mul_2 [Mul] inputs: [StatefulPartitionedCall/Postprocessor/Decode/truediv:0 -> (130944)], [StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/sub_1:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/mul_2 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/mul_2
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/mul_2:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/mul_2:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/mul_2 [Mul] outputs: [StatefulPartitionedCall/Postprocessor/Decode/mul_2:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/mul [Mul]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/Exp:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/sub:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/mul [Mul] inputs: [StatefulPartitionedCall/Postprocessor/Decode/Exp:0 -> (130944)], [StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/sub:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/mul for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/mul
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/mul:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/mul:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/mul [Mul] outputs: [StatefulPartitionedCall/Postprocessor/Decode/mul:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/mul_1 [Mul]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/Exp_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/sub_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/mul_1 [Mul] inputs: [StatefulPartitionedCall/Postprocessor/Decode/Exp_1:0 -> (130944)], [StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/sub_1:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/mul_1 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/mul_1
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/mul_1:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/mul_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/mul_1 [Mul] outputs: [StatefulPartitionedCall/Postprocessor/Decode/mul_1:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/add_1 [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/mul_3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/add_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/add_1 [Add] inputs: [StatefulPartitionedCall/Postprocessor/Decode/mul_3:0 -> (130944)], [StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/add_1:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/add_1 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/add_1
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/add_1:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/add_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/add_1 [Add] outputs: [StatefulPartitionedCall/Postprocessor/Decode/add_1:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/add [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/mul_2:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/add [Add] inputs: [StatefulPartitionedCall/Postprocessor/Decode/mul_2:0 -> (130944)], [StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/add:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/add for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/add
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/add:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/add [Add] outputs: [StatefulPartitionedCall/Postprocessor/Decode/add:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/truediv_5 [Mul]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/mul:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/truediv_recip:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/truediv_5 [Mul] inputs: [StatefulPartitionedCall/Postprocessor/Decode/mul:0 -> (130944)], [ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/truediv_recip:0 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/truediv_5 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/truediv_5
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/truediv_5:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/truediv_5:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/truediv_5 [Mul] outputs: [StatefulPartitionedCall/Postprocessor/Decode/truediv_5:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/truediv_6 [Mul]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/mul_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/truediv_recip:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/truediv_6 [Mul] inputs: [StatefulPartitionedCall/Postprocessor/Decode/mul_1:0 -> (130944)], [ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/truediv_recip:0 -> ()], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/truediv_6 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/truediv_6
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/truediv_6:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/truediv_6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/truediv_6 [Mul] outputs: [StatefulPartitionedCall/Postprocessor/Decode/truediv_6:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/sub_1 [Sub]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/add_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/truediv_5:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/sub_1 [Sub] inputs: [StatefulPartitionedCall/Postprocessor/Decode/add_1:0 -> (130944)], [StatefulPartitionedCall/Postprocessor/Decode/truediv_5:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/sub_1 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/sub_1
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/sub_1:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/sub_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/sub_1 [Sub] outputs: [StatefulPartitionedCall/Postprocessor/Decode/sub_1:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/add_3 [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/add_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/truediv_5:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/add_3 [Add] inputs: [StatefulPartitionedCall/Postprocessor/Decode/add_1:0 -> (130944)], [StatefulPartitionedCall/Postprocessor/Decode/truediv_5:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/add_3 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/add_3
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/add_3:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/add_3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/add_3 [Add] outputs: [StatefulPartitionedCall/Postprocessor/Decode/add_3:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/sub [Sub]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/truediv_6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/sub [Sub] inputs: [StatefulPartitionedCall/Postprocessor/Decode/add:0 -> (130944)], [StatefulPartitionedCall/Postprocessor/Decode/truediv_6:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/sub for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/sub
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/sub:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/sub:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/sub [Sub] outputs: [StatefulPartitionedCall/Postprocessor/Decode/sub:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/add_2 [Add]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/add:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/truediv_6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/add_2 [Add] inputs: [StatefulPartitionedCall/Postprocessor/Decode/add:0 -> (130944)], [StatefulPartitionedCall/Postprocessor/Decode/truediv_6:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/add_2 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/add_2
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/add_2:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/add_2:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/add_2 [Add] outputs: [StatefulPartitionedCall/Postprocessor/Decode/add_2:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__657 [Unsqueeze]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/sub_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__657 [Unsqueeze] inputs: [StatefulPartitionedCall/Postprocessor/Decode/sub_1:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] onnx2trt_utils.cpp:1793: Original shape: (130944,), unsqueezing to: (1, 130944)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__657 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__657
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__657:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__657:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__657 [Unsqueeze] outputs: [StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__657:0 -> (1, 130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__659 [Unsqueeze]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/add_3:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__659 [Unsqueeze] inputs: [StatefulPartitionedCall/Postprocessor/Decode/add_3:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] onnx2trt_utils.cpp:1793: Original shape: (130944,), unsqueezing to: (1, 130944)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__659 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__659
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__659:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__659:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__659 [Unsqueeze] outputs: [StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__659:0 -> (1, 130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__656 [Unsqueeze]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/sub:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__656 [Unsqueeze] inputs: [StatefulPartitionedCall/Postprocessor/Decode/sub:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] onnx2trt_utils.cpp:1793: Original shape: (130944,), unsqueezing to: (1, 130944)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__656 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__656
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__656:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__656:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__656 [Unsqueeze] outputs: [StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__656:0 -> (1, 130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__658 [Unsqueeze]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/add_2:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__658 [Unsqueeze] inputs: [StatefulPartitionedCall/Postprocessor/Decode/add_2:0 -> (130944)], 
[08/16/2021-04:50:09] [V] [TRT] onnx2trt_utils.cpp:1793: Original shape: (130944,), unsqueezing to: (1, 130944)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__658 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__658
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__658:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__658:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__658 [Unsqueeze] outputs: [StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__658:0 -> (1, 130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/stack_Concat__660 [Concat]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__656:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__657:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__658:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__659:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/stack_Concat__660 [Concat] inputs: [StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__656:0 -> (1, 130944)], [StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__657:0 -> (1, 130944)], [StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__658:0 -> (1, 130944)], [StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__659:0 -> (1, 130944)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/stack_Concat__660 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/stack_Concat__660
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/stack_Concat__660:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/stack_Concat__660:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/stack_Concat__660 [Concat] outputs: [StatefulPartitionedCall/Postprocessor/Decode/stack_Concat__660:0 -> (4, 130944)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Decode/transpose_1 [Transpose]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/stack_Concat__660:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Decode/transpose_1 [Transpose] inputs: [StatefulPartitionedCall/Postprocessor/Decode/stack_Concat__660:0 -> (4, 130944)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Decode/transpose_1 for ONNX node: StatefulPartitionedCall/Postprocessor/Decode/transpose_1
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Decode/transpose_1:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Decode/transpose_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Decode/transpose_1 [Transpose] outputs: [StatefulPartitionedCall/Postprocessor/Decode/transpose_1:0 -> (130944, 4)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/Reshape_2 [Reshape]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Decode/transpose_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__808
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/Reshape_2 [Reshape] inputs: [StatefulPartitionedCall/Postprocessor/Decode/transpose_1:0 -> (130944, 4)], [const_fold_opt__808 -> (3)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/Reshape_2 for ONNX node: StatefulPartitionedCall/Postprocessor/Reshape_2
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/Reshape_2:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/Reshape_2:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/Reshape_2 [Reshape] outputs: [StatefulPartitionedCall/Postprocessor/Reshape_2:0 -> (1, 130944, 4)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/Postprocessor/ExpandDims_1 [Unsqueeze]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/Reshape_2:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/Postprocessor/ExpandDims_1 [Unsqueeze] inputs: [StatefulPartitionedCall/Postprocessor/Reshape_2:0 -> (1, 130944, 4)], 
[08/16/2021-04:50:09] [V] [TRT] onnx2trt_utils.cpp:1793: Original shape: (1, 130944, 4), unsqueezing to: (1, 130944, 1, 4)
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/Postprocessor/ExpandDims_1 for ONNX node: StatefulPartitionedCall/Postprocessor/ExpandDims_1
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/Postprocessor/ExpandDims_1:0 for ONNX tensor: StatefulPartitionedCall/Postprocessor/ExpandDims_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/Postprocessor/ExpandDims_1 [Unsqueeze] outputs: [StatefulPartitionedCall/Postprocessor/ExpandDims_1:0 -> (1, 130944, 1, 4)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node: Identity_Out_2 [Identity]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/Postprocessor/ExpandDims_1:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125: Identity_Out_2 [Identity] inputs: [StatefulPartitionedCall/Postprocessor/ExpandDims_1:0 -> (1, 130944, 1, 4)], 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: Identity_Out_2 for ONNX node: Identity_Out_2
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: Identity_6:0 for ONNX tensor: Identity_6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179: Identity_Out_2 [Identity] outputs: [Identity_6:0 -> (1, 130944, 1, 4)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:103: Parsing node:  [BatchedNMS_TRT]
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: Identity_6:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:119: Searching for input: Identity_7:0
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:125:  [BatchedNMS_TRT] inputs: [Identity_6:0 -> (1, 130944, 1, 4)], [Identity_7:0 -> (1, 130944, 91)], 
[08/16/2021-04:50:09] [I] [TRT] ModelImporter.cpp:135: No importer registered for op: BatchedNMS_TRT. Attempting to import as plugin.
[08/16/2021-04:50:09] [I] [TRT] builtin_op_importers.cpp:3659: Searching for plugin: BatchedNMS_TRT, plugin_version: 1, plugin_namespace: 
[08/16/2021-04:50:09] [I] [TRT] builtin_op_importers.cpp:3676: Successfully created plugin: BatchedNMS_TRT
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 341) [PluginV2Ext] for ONNX node: 
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: num_detections_1 for ONNX tensor: num_detections
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: boxes_1 for ONNX tensor: boxes
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: scores_1 for ONNX tensor: scores
[08/16/2021-04:50:09] [V] [TRT] ImporterContext.hpp:116: Registering tensor: classes_1 for ONNX tensor: classes
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:179:  [BatchedNMS_TRT] outputs: [num_detections -> (1)], [boxes -> (1, 100, 4)], [scores -> (1, 100)], [classes -> (1, 100)], 
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:507: Marking num_detections_1 as output: num_detections
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:507: Marking boxes_1 as output: boxes
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:507: Marking scores_1 as output: scores
[08/16/2021-04:50:09] [V] [TRT] ModelImporter.cpp:507: Marking classes_1 as output: classes
 ----- Parsing of ONNX model resnet50-512_unsqueezed_float.onnx is Done ---- 
[08/16/2021-04:50:09] [V] [TRT] Applying generic optimizations to the graph for inference.
[08/16/2021-04:50:09] [V] [TRT] Original: 328 layers
[08/16/2021-04:50:09] [V] [TRT] After dead-layer removal: 328 layers
[08/16/2021-04:50:09] [V] [TRT] Fusing (Unnamed Layer* 1) [Constant] with (Unnamed Layer* 2) [Shuffle]
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/Preprocessor/ResizeImage/resize/Squeeze with StatefulPartitionedCall/Preprocessor/stack
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/Preprocessor/ResizeImage/resize/Squeeze + StatefulPartitionedCall/Preprocessor/stack with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D__9
[08/16/2021-04:50:09] [V] [TRT] Removing StatefulPartitionedCall/Preprocessor/ResizeImage/resize/Squeeze + StatefulPartitionedCall/Preprocessor/stack + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D__9
[08/16/2021-04:50:09] [V] [TRT] Fusing Transpose__786 with StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape
[08/16/2021-04:50:09] [V] [TRT] Fusing Transpose__786 + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape with Transpose__732
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__359 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__386 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__419 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__446 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__479 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__506 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4
[08/16/2021-04:50:09] [V] [TRT] Fusing Transpose__788 with StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape
[08/16/2021-04:50:09] [V] [TRT] Fusing Transpose__788 + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape with Transpose__738
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__548 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__575 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__617 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__644 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/Postprocessor/Reshape_1 with StatefulPartitionedCall/Postprocessor/Decode/transpose
[08/16/2021-04:50:09] [V] [TRT] Fusing (Unnamed Layer* 296) [Constant] with (Unnamed Layer* 297) [Shuffle]
[08/16/2021-04:50:09] [V] [TRT] Fusing (Unnamed Layer* 299) [Constant] with (Unnamed Layer* 300) [Shuffle]
[08/16/2021-04:50:09] [V] [TRT] Fusing (Unnamed Layer* 302) [Constant] with (Unnamed Layer* 303) [Shuffle]
[08/16/2021-04:50:09] [V] [TRT] Fusing (Unnamed Layer* 305) [Constant] with (Unnamed Layer* 306) [Shuffle]
[08/16/2021-04:50:09] [V] [TRT] Fusing (Unnamed Layer* 322) [Constant] with (Unnamed Layer* 323) [Shuffle]
[08/16/2021-04:50:09] [V] [TRT] Fusing (Unnamed Layer* 325) [Constant] with (Unnamed Layer* 326) [Shuffle]
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/Postprocessor/Decode/transpose_1 with StatefulPartitionedCall/Postprocessor/Reshape_2
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/Postprocessor/Decode/transpose_1 + StatefulPartitionedCall/Postprocessor/Reshape_2 with StatefulPartitionedCall/Postprocessor/ExpandDims_1
[08/16/2021-04:50:09] [V] [TRT] After Myelin optimization: 301 layers
[08/16/2021-04:50:09] [V] [TRT] Fusing convolution weights from StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D with scale StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_batchnorm/FusedBatchNormV3
[08/16/2021-04:50:09] [V] [TRT] Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3
[08/16/2021-04:50:09] [V] [TRT] Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3
[08/16/2021-04:50:09] [V] [TRT] After scale fusion: 298 layers
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_add/add
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_add/add with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_add/add
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_add/add with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_add/add
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_add/add with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_add/add
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_add/add with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd with StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_add/add
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_add/add with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_add/add
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_add/add with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_add/add
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_add/add with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_add/add
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_add/add with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd with StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_relu/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_add/add
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_add/add with StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_out/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_2 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_2/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D with StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_3 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_3/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_2 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_2/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_2 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_2/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_2 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_2/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_4 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_4/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_3 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_3/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_1 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_1/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_0/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_1 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_1/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_1 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_1/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_3 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_3/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_3 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_3/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_4 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_4/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_4 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_4/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_4 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_4/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_1 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_1/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_1 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_1/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_0/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_0/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_0/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_0/Relu6
[08/16/2021-04:50:09] [V] [TRT] Fusing (Unnamed Layer* 302) [Constant] + (Unnamed Layer* 303) [Shuffle] with StatefulPartitionedCall/Postprocessor/Decode/truediv_1
[08/16/2021-04:50:09] [V] [TRT] Fusing PWN((Unnamed Layer* 302) [Constant] + (Unnamed Layer* 303) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_1) with StatefulPartitionedCall/Postprocessor/Decode/mul_3
[08/16/2021-04:50:09] [V] [TRT] Fusing PWN(PWN((Unnamed Layer* 302) [Constant] + (Unnamed Layer* 303) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_1), StatefulPartitionedCall/Postprocessor/Decode/mul_3) with StatefulPartitionedCall/Postprocessor/Decode/add_1
[08/16/2021-04:50:09] [V] [TRT] Fusing (Unnamed Layer* 296) [Constant] + (Unnamed Layer* 297) [Shuffle] with StatefulPartitionedCall/Postprocessor/Decode/truediv_3
[08/16/2021-04:50:09] [V] [TRT] Fusing PWN((Unnamed Layer* 296) [Constant] + (Unnamed Layer* 297) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_3) with StatefulPartitionedCall/Postprocessor/Decode/Exp
[08/16/2021-04:50:09] [V] [TRT] Fusing PWN(PWN((Unnamed Layer* 296) [Constant] + (Unnamed Layer* 297) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_3), StatefulPartitionedCall/Postprocessor/Decode/Exp) with StatefulPartitionedCall/Postprocessor/Decode/mul
[08/16/2021-04:50:09] [V] [TRT] Fusing PWN(PWN(PWN((Unnamed Layer* 296) [Constant] + (Unnamed Layer* 297) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_3), StatefulPartitionedCall/Postprocessor/Decode/Exp), StatefulPartitionedCall/Postprocessor/Decode/mul) with StatefulPartitionedCall/Postprocessor/Decode/truediv_5
[08/16/2021-04:50:09] [V] [TRT] Fusing (Unnamed Layer* 322) [Constant] + (Unnamed Layer* 323) [Shuffle] with PWN(PWN(PWN(PWN((Unnamed Layer* 296) [Constant] + (Unnamed Layer* 297) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_3), StatefulPartitionedCall/Postprocessor/Decode/Exp), StatefulPartitionedCall/Postprocessor/Decode/mul), StatefulPartitionedCall/Postprocessor/Decode/truediv_5)
[08/16/2021-04:50:09] [V] [TRT] Fusing (Unnamed Layer* 305) [Constant] + (Unnamed Layer* 306) [Shuffle] with StatefulPartitionedCall/Postprocessor/Decode/truediv
[08/16/2021-04:50:09] [V] [TRT] Fusing PWN((Unnamed Layer* 305) [Constant] + (Unnamed Layer* 306) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv) with StatefulPartitionedCall/Postprocessor/Decode/mul_2
[08/16/2021-04:50:09] [V] [TRT] Fusing PWN(PWN((Unnamed Layer* 305) [Constant] + (Unnamed Layer* 306) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv), StatefulPartitionedCall/Postprocessor/Decode/mul_2) with StatefulPartitionedCall/Postprocessor/Decode/add
[08/16/2021-04:50:09] [V] [TRT] Fusing (Unnamed Layer* 299) [Constant] + (Unnamed Layer* 300) [Shuffle] with StatefulPartitionedCall/Postprocessor/Decode/truediv_2
[08/16/2021-04:50:09] [V] [TRT] Fusing PWN((Unnamed Layer* 299) [Constant] + (Unnamed Layer* 300) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_2) with StatefulPartitionedCall/Postprocessor/Decode/Exp_1
[08/16/2021-04:50:09] [V] [TRT] Fusing PWN(PWN((Unnamed Layer* 299) [Constant] + (Unnamed Layer* 300) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_2), StatefulPartitionedCall/Postprocessor/Decode/Exp_1) with StatefulPartitionedCall/Postprocessor/Decode/mul_1
[08/16/2021-04:50:09] [V] [TRT] Fusing PWN(PWN(PWN((Unnamed Layer* 299) [Constant] + (Unnamed Layer* 300) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_2), StatefulPartitionedCall/Postprocessor/Decode/Exp_1), StatefulPartitionedCall/Postprocessor/Decode/mul_1) with StatefulPartitionedCall/Postprocessor/Decode/truediv_6
[08/16/2021-04:50:09] [V] [TRT] Fusing (Unnamed Layer* 325) [Constant] + (Unnamed Layer* 326) [Shuffle] with PWN(PWN(PWN(PWN((Unnamed Layer* 299) [Constant] + (Unnamed Layer* 300) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_2), StatefulPartitionedCall/Postprocessor/Decode/Exp_1), StatefulPartitionedCall/Postprocessor/Decode/mul_1), StatefulPartitionedCall/Postprocessor/Decode/truediv_6)
[08/16/2021-04:50:09] [V] [TRT] After vertical fusions: 171 layers
[08/16/2021-04:50:09] [V] [TRT] After final dead-layer removal: 171 layers
[08/16/2021-04:50:09] [V] [TRT] Merging layers: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6
[08/16/2021-04:50:09] [V] [TRT] Merging layers: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6
[08/16/2021-04:50:09] [V] [TRT] Merging layers: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6
[08/16/2021-04:50:09] [V] [TRT] Merging layers: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6
[08/16/2021-04:50:09] [V] [TRT] Merging layers: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6
[08/16/2021-04:50:09] [V] [TRT] After tensor merging: 166 layers
[08/16/2021-04:50:09] [V] [TRT] Replacing slice StatefulPartitionedCall/Preprocessor/unstack with copy from StatefulPartitionedCall/Preprocessor/sub:0 to StatefulPartitionedCall/Preprocessor/unstack:0
[08/16/2021-04:50:09] [V] [TRT] Replacing slice StatefulPartitionedCall/Postprocessor/Decode/unstack_1 with copy from StatefulPartitionedCall/Postprocessor/Decode/transpose:0 to StatefulPartitionedCall/Postprocessor/Decode/unstack:1
[08/16/2021-04:50:09] [V] [TRT] Replacing slice StatefulPartitionedCall/Postprocessor/Decode/unstack_3 with copy from StatefulPartitionedCall/Postprocessor/Decode/transpose:0 to StatefulPartitionedCall/Postprocessor/Decode/unstack:3
[08/16/2021-04:50:09] [V] [TRT] Replacing slice StatefulPartitionedCall/Postprocessor/Decode/unstack with copy from StatefulPartitionedCall/Postprocessor/Decode/transpose:0 to StatefulPartitionedCall/Postprocessor/Decode/unstack:0
[08/16/2021-04:50:09] [V] [TRT] Replacing slice StatefulPartitionedCall/Postprocessor/Decode/unstack_2 with copy from StatefulPartitionedCall/Postprocessor/Decode/transpose:0 to StatefulPartitionedCall/Postprocessor/Decode/unstack:2
[08/16/2021-04:50:09] [V] [TRT] Eliminating concatenation StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Concat__510
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 to StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Concat__510:0
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 to StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Concat__510:0
[08/16/2021-04:50:09] [V] [TRT] Eliminating concatenation StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Concat__513
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 to StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Concat__513:0
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 to StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Concat__513:0
[08/16/2021-04:50:09] [V] [TRT] Eliminating concatenation StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Concat__579
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 to StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Concat__579:0
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 to StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Concat__579:0
[08/16/2021-04:50:09] [V] [TRT] Eliminating concatenation StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Concat__582
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 to StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Concat__582:0
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 to StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Concat__582:0
[08/16/2021-04:50:09] [V] [TRT] Eliminating concatenation StatefulPartitionedCall/concat_1
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape:0 to StatefulPartitionedCall/concat_1:0
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 to StatefulPartitionedCall/concat_1:0
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2:0 to StatefulPartitionedCall/concat_1:0
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 to StatefulPartitionedCall/concat_1:0
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4:0 to StatefulPartitionedCall/concat_1:0
[08/16/2021-04:50:09] [V] [TRT] Eliminating concatenation StatefulPartitionedCall/concat
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 to StatefulPartitionedCall/concat:0
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 to StatefulPartitionedCall/concat:0
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 to StatefulPartitionedCall/concat:0
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 to StatefulPartitionedCall/concat:0
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 to StatefulPartitionedCall/concat:0
[08/16/2021-04:50:09] [V] [TRT] Eliminating concatenation StatefulPartitionedCall/Postprocessor/Decode/stack_Concat__660
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__656:0 to StatefulPartitionedCall/Postprocessor/Decode/stack_Concat__660:0
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__657:0 to StatefulPartitionedCall/Postprocessor/Decode/stack_Concat__660:0
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__658:0 to StatefulPartitionedCall/Postprocessor/Decode/stack_Concat__660:0
[08/16/2021-04:50:09] [V] [TRT] Generating copy for StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__659:0 to StatefulPartitionedCall/Postprocessor/Decode/stack_Concat__660:0
[08/16/2021-04:50:09] [V] [TRT] After concat removal: 181 layers
[08/16/2021-04:50:09] [V] [TRT] Graph construction and optimization completed in 0.221634 seconds.
[08/16/2021-04:50:09] [I] [TRT] 
[08/16/2021-04:50:09] [I] [TRT] --------------- Layers running on DLA: 
[08/16/2021-04:50:09] [I] [TRT] 
[08/16/2021-04:50:09] [I] [TRT] --------------- Layers running on GPU: 
[08/16/2021-04:50:09] [I] [TRT] (Unnamed Layer* 1) [Constant] + (Unnamed Layer* 2) [Shuffle], StatefulPartitionedCall/Cast, StatefulPartitionedCall/Preprocessor/sub, StatefulPartitionedCall/Preprocessor/unstack, Transpose__663, Resize__21, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_out/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_out/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_out/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_out/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_out/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_out/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_out/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_out/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_relu/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_out/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd, StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508, StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy, StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy, StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512, StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy, StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy, Transpose__786 + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape + Transpose__732, StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_2/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6, StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577, StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy, StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy, StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581, StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy, StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy, Transpose__788 + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape + Transpose__738, StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1, StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_3/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_2/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_2/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_2/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_4/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_3/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_1/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_0/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_1/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_1/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_3/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_3/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_4/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_4/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_4/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_1/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_1/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_0/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_0/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_0/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_0/Relu6, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__359 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__419 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__479 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__548 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__617 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape:0 copy, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 copy, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2:0 copy, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 copy, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4:0 copy, StatefulPartitionedCall/Postprocessor/convert_scores, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__386 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__446 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__506 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__575 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__644 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy, StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy, StatefulPartitionedCall/Postprocessor/Reshape_1 + StatefulPartitionedCall/Postprocessor/Decode/transpose, StatefulPartitionedCall/Postprocessor/Decode/unstack_1, StatefulPartitionedCall/Postprocessor/Decode/unstack__648, (Unnamed Layer* 310) [Constant], (Unnamed Layer* 318) [Constant], PWN(PWN(PWN((Unnamed Layer* 302) [Constant] + (Unnamed Layer* 303) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_1), StatefulPartitionedCall/Postprocessor/Decode/mul_3), StatefulPartitionedCall/Postprocessor/Decode/add_1), StatefulPartitionedCall/Postprocessor/Decode/unstack_3, StatefulPartitionedCall/Postprocessor/Decode/unstack__650, (Unnamed Layer* 314) [Constant], PWN((Unnamed Layer* 322) [Constant] + (Unnamed Layer* 323) [Shuffle], PWN(PWN(PWN(PWN((Unnamed Layer* 296) [Constant] + (Unnamed Layer* 297) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_3), StatefulPartitionedCall/Postprocessor/Decode/Exp), StatefulPartitionedCall/Postprocessor/Decode/mul), StatefulPartitionedCall/Postprocessor/Decode/truediv_5)), StatefulPartitionedCall/Postprocessor/Decode/sub_1, StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__657, StatefulPartitionedCall/Postprocessor/Decode/add_3, StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__659, StatefulPartitionedCall/Postprocessor/Decode/unstack, StatefulPartitionedCall/Postprocessor/Decode/unstack__647, (Unnamed Layer* 312) [Constant], (Unnamed Layer* 320) [Constant], PWN(PWN(PWN((Unnamed Layer* 305) [Constant] + (Unnamed Layer* 306) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv), StatefulPartitionedCall/Postprocessor/Decode/mul_2), StatefulPartitionedCall/Postprocessor/Decode/add), StatefulPartitionedCall/Postprocessor/Decode/unstack_2, StatefulPartitionedCall/Postprocessor/Decode/unstack__649, (Unnamed Layer* 316) [Constant], PWN((Unnamed Layer* 325) [Constant] + (Unnamed Layer* 326) [Shuffle], PWN(PWN(PWN(PWN((Unnamed Layer* 299) [Constant] + (Unnamed Layer* 300) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_2), StatefulPartitionedCall/Postprocessor/Decode/Exp_1), StatefulPartitionedCall/Postprocessor/Decode/mul_1), StatefulPartitionedCall/Postprocessor/Decode/truediv_6)), StatefulPartitionedCall/Postprocessor/Decode/sub, StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__656, StatefulPartitionedCall/Postprocessor/Decode/add_2, StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__658, StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__656:0 copy, StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__657:0 copy, StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__658:0 copy, StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__659:0 copy, StatefulPartitionedCall/Postprocessor/Decode/transpose_1 + StatefulPartitionedCall/Postprocessor/Reshape_2 + StatefulPartitionedCall/Postprocessor/ExpandDims_1, Identity_Out_2, (Unnamed Layer* 341) [PluginV2Ext], 
[08/16/2021-04:50:11] [V] [TRT] Constructing optimization profile number 0 [1/1].
[08/16/2021-04:50:11] [V] [TRT] *************** Autotuning format combination:  -> Float(1,3,3,3) ***************
[08/16/2021-04:50:11] [V] [TRT] *************** Autotuning format combination:  -> Half(1,3,3,3) ***************
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:11] [V] [TRT] Tactic: 1002 time 0.74356
[08/16/2021-04:50:11] [V] [TRT] Tactic: 0 time 1.75219
[08/16/2021-04:50:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.74356
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:11] [V] [TRT] Tactic: 1002 time 0.3021
[08/16/2021-04:50:11] [V] [TRT] Tactic: 0 time 0.45306
[08/16/2021-04:50:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.3021
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:11] [V] [TRT] Tactic: 1002 time 0.799524
[08/16/2021-04:50:11] [V] [TRT] Tactic: 0 time 0.200256
[08/16/2021-04:50:11] [V] [TRT] Fastest Tactic: 0 Time: 0.200256
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:11] [V] [TRT] Tactic: 1002 time 0.570692
[08/16/2021-04:50:11] [V] [TRT] Tactic: 0 time 0.175872
[08/16/2021-04:50:11] [V] [TRT] Fastest Tactic: 0 Time: 0.175872
[08/16/2021-04:50:11] [V] [TRT] *************** Autotuning format combination: Float(1,3,1536,786432) -> Float(1,3,1536,786432) ***************
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Cast (Reformat)
[08/16/2021-04:50:11] [V] [TRT] Tactic: 1002 time 0.319004
[08/16/2021-04:50:11] [V] [TRT] Tactic: 0 time 0.178724
[08/16/2021-04:50:11] [V] [TRT] Fastest Tactic: 0 Time: 0.178724
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Cast (Cast)
[08/16/2021-04:50:11] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:50:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:50:11] [V] [TRT] 
[08/16/2021-04:50:11] [V] [TRT] *************** Autotuning format combination: Float(1,3,1536,786432) -> Float(1,3,1536:32,24576) ***************
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Cast (Reformat)
[08/16/2021-04:50:11] [V] [TRT] Tactic: 1002 time 0.561048
[08/16/2021-04:50:11] [V] [TRT] Tactic: 0 time 1.33424
[08/16/2021-04:50:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.561048
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Cast (Cast)
[08/16/2021-04:50:11] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:50:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002
[08/16/2021-04:50:11] [V] [TRT] 
[08/16/2021-04:50:11] [V] [TRT] *************** Autotuning format combination: Float(1,3,1536:32,24576) -> Float(1,3,1536,786432) ***************
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Cast (Reformat)
[08/16/2021-04:50:11] [V] [TRT] Tactic: 1002 time 0.9199
[08/16/2021-04:50:11] [V] [TRT] Tactic: 0 time 0.505628
[08/16/2021-04:50:11] [V] [TRT] Fastest Tactic: 0 Time: 0.505628
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Cast (Cast)
[08/16/2021-04:50:11] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:50:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:50:11] [V] [TRT] 
[08/16/2021-04:50:11] [V] [TRT] *************** Autotuning format combination: Float(1,3,1536:32,24576) -> Float(1,3,1536:32,24576) ***************
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Cast (Reformat)
[08/16/2021-04:50:11] [V] [TRT] Tactic: 1002 time 0.59098
[08/16/2021-04:50:11] [V] [TRT] Tactic: 0 time 0.179124
[08/16/2021-04:50:11] [V] [TRT] Fastest Tactic: 0 Time: 0.179124
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Cast (Cast)
[08/16/2021-04:50:11] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:50:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:50:11] [V] [TRT] 
[08/16/2021-04:50:11] [V] [TRT] *************** Autotuning format combination: Half(1,3,1536,786432) -> Float(1,3,1536,786432) ***************
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Cast (Reformat)
[08/16/2021-04:50:11] [V] [TRT] Tactic: 1002 time 0.31568
[08/16/2021-04:50:11] [V] [TRT] Tactic: 0 time 0.434404
[08/16/2021-04:50:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.31568
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Cast (Cast)
[08/16/2021-04:50:11] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:50:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002
[08/16/2021-04:50:11] [V] [TRT] 
[08/16/2021-04:50:11] [V] [TRT] *************** Autotuning format combination: Half(1,3,1536,786432) -> Float(1,3,1536:32,24576) ***************
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Cast (Reformat)
[08/16/2021-04:50:11] [V] [TRT] Tactic: 1002 time 0.565128
[08/16/2021-04:50:11] [V] [TRT] Tactic: 0 time 1.2687
[08/16/2021-04:50:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.565128
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Cast (Cast)
[08/16/2021-04:50:11] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:50:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002
[08/16/2021-04:50:11] [V] [TRT] 
[08/16/2021-04:50:11] [V] [TRT] *************** Autotuning format combination: Half(1,3,1536:2,393216) -> Float(1,3,1536,786432) ***************
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Cast (Reformat)
[08/16/2021-04:50:11] [V] [TRT] Tactic: 1002 time 0.73974
[08/16/2021-04:50:11] [V] [TRT] Tactic: 0 time 0.157508
[08/16/2021-04:50:11] [V] [TRT] Fastest Tactic: 0 Time: 0.157508
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Cast (Cast)
[08/16/2021-04:50:11] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:50:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:50:11] [V] [TRT] 
[08/16/2021-04:50:11] [V] [TRT] *************** Autotuning format combination: Half(1,3,1536:2,393216) -> Float(1,3,1536:32,24576) ***************
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Cast (Reformat)
[08/16/2021-04:50:11] [V] [TRT] Tactic: 1002 time 0.454396
[08/16/2021-04:50:11] [V] [TRT] Tactic: 0 time 1.06614
[08/16/2021-04:50:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.454396
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Cast (Cast)
[08/16/2021-04:50:11] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:50:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002
[08/16/2021-04:50:11] [V] [TRT] 
[08/16/2021-04:50:11] [V] [TRT] *************** Autotuning format combination: Half(64,192,1:8,98304) -> Float(1,3,1536,786432) ***************
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Cast (Reformat)
[08/16/2021-04:50:11] [V] [TRT] Tactic: 1002 time 0.45892
[08/16/2021-04:50:11] [V] [TRT] Tactic: 0 time 0.131172
[08/16/2021-04:50:11] [V] [TRT] Fastest Tactic: 0 Time: 0.131172
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Cast (Cast)
[08/16/2021-04:50:11] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:50:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:50:11] [V] [TRT] 
[08/16/2021-04:50:11] [V] [TRT] *************** Autotuning format combination: Half(64,192,1:8,98304) -> Float(1,3,1536:32,24576) ***************
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Cast (Reformat)
[08/16/2021-04:50:11] [V] [TRT] Tactic: 1002 time 0.492804
[08/16/2021-04:50:11] [V] [TRT] Tactic: 0 time 1.34195
[08/16/2021-04:50:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.492804
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Cast (Cast)
[08/16/2021-04:50:11] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:50:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002
[08/16/2021-04:50:11] [V] [TRT] 
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:11] [V] [TRT] Tactic: 1002 time 0.745628
[08/16/2021-04:50:11] [V] [TRT] Tactic: 0 time 0.406188
[08/16/2021-04:50:11] [V] [TRT] Fastest Tactic: 0 Time: 0.406188
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:11] [V] [TRT] Tactic: 1002 time 0.638496
[08/16/2021-04:50:11] [V] [TRT] Tactic: 0 time 0.312536
[08/16/2021-04:50:11] [V] [TRT] Fastest Tactic: 0 Time: 0.312536
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:11] [V] [TRT] Tactic: 1002 time 0.595272
[08/16/2021-04:50:11] [V] [TRT] Tactic: 0 time 0.327304
[08/16/2021-04:50:11] [V] [TRT] Fastest Tactic: 0 Time: 0.327304
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:11] [V] [TRT] Tactic: 1002 time 0.409092
[08/16/2021-04:50:11] [V] [TRT] Tactic: 0 time 0.302984
[08/16/2021-04:50:11] [V] [TRT] Fastest Tactic: 0 Time: 0.302984
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:11] [V] [TRT] Tactic: 1002 time 0.2529
[08/16/2021-04:50:11] [V] [TRT] Tactic: 0 time 0.296776
[08/16/2021-04:50:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.2529
[08/16/2021-04:50:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:11] [V] [TRT] Tactic: 1002 time 0.395096
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.9069
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.395096
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.546868
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.134804
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.134804
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.394556
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.1283
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.1283
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.634256
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.140636
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.140636
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.389796
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.908072
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.389796
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.637336
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.121136
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.121136
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.394268
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.10336
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.10336
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.393064
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.110292
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.110292
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.354272
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.976492
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.354272
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.34454
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.080532
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.080532
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.535936
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.076836
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.076836
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.011608
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.006824
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.006824
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.006988
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.006852
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.006852
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.0114
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.006952
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.006952
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.011488
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.006872
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.006872
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.009604
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.006972
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.006972
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.009924
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.007024
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.007024
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.011076
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.006972
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.006972
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.011684
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.006904
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.006904
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.0069
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.006744
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.006744
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.011652
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.006804
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.006804
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.0112
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.006836
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.006836
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.011592
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.006836
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.006836
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.011092
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.006752
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.006752
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.011752
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.00682
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00682
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.01146
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.006852
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.006852
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.011616
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.00678
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00678
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.011688
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.006936
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.006936
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.011672
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.007052
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.007052
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.011664
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.006892
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.006892
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.011536
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.0069
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.0069
[08/16/2021-04:50:12] [V] [TRT] *************** Autotuning format combination: Float(1,3,1536,786432), Float(1,3,3,3) -> Float(1,3,1536,786432) ***************
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/sub (ElementWise)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1 time 0.165472
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 1 Time: 0.165472
[08/16/2021-04:50:12] [V] [TRT] *************** Autotuning format combination: Float(1,3,1536:32,24576), Float(1,3,3:32,3) -> Float(1,3,1536:32,24576) ***************
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/sub (ElementWise)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1 time 0.189276
[08/16/2021-04:50:12] [V] [TRT] Tactic: 2 time 0.554912
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 1 Time: 0.189276
[08/16/2021-04:50:12] [V] [TRT] *************** Autotuning format combination: Half(1,3,1536,786432), Half(1,3,3,3) -> Half(1,3,1536,786432) ***************
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/sub (ElementWise)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1 time 0.171296
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 1 Time: 0.171296
[08/16/2021-04:50:12] [V] [TRT] *************** Autotuning format combination: Half(1,3,1536:2,393216), Half(1,3,3:2,3) -> Half(1,3,1536:2,393216) ***************
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/sub (ElementWise)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1 time 0.140316
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 1 Time: 0.140316
[08/16/2021-04:50:12] [V] [TRT] *************** Autotuning format combination: Half(64,192,1:8,98304), Half(1,3,1:8,3) -> Half(64,192,1:8,98304) ***************
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/sub (ElementWise)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1 time 0.094
[08/16/2021-04:50:12] [V] [TRT] Tactic: 2 time 0.09926
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 1 Time: 0.094
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.22862
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.141524
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.141524
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.3379
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.779092
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.3379
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.211312
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.264332
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.211312
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.471692
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.124964
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.124964
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.33904
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.11424
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.11424
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.482112
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.296644
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.296644
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.351924
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.142436
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.142436
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.551852
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.269408
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.269408
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.510496
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.280164
[08/16/2021-04:50:12] [V] [TRT] Fastest Tactic: 0 Time: 0.280164
[08/16/2021-04:50:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:12] [V] [TRT] Tactic: 1002 time 0.351784
[08/16/2021-04:50:12] [V] [TRT] Tactic: 0 time 0.260628
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.260628
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.230236
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.2544
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.230236
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.33848
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.77628
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.33848
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.20892
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.074688
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.074688
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.46774
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.11796
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.11796
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.346464
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.108552
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.108552
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.54874
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.128976
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.128976
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.336172
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.777004
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.336172
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.549756
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.107796
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.107796
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.448396
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.075808
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.075808
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.323076
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.095372
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.095372
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.3242
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.109596
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.109596
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.335564
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.924864
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.335564
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.324448
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.078088
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.078088
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.506544
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.075612
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.075612
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Preprocessor/unstack (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.485496
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.075232
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.075232
[08/16/2021-04:50:13] [V] [TRT] *************** Autotuning format combination: Float(1,3,1536,786432) -> Float(1,512,262144,786432) ***************
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: Transpose__663 (Shuffle)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.269296
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1 time 1.33774
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.269296
[08/16/2021-04:50:13] [V] [TRT] *************** Autotuning format combination: Float(1,3,1536:32,24576) -> Float(1,512,262144:32,262144) ***************
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: Transpose__663 (Shuffle)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.82536
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1 time 2.7798
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.82536
[08/16/2021-04:50:13] [V] [TRT] *************** Autotuning format combination: Half(1,3,1536,786432) -> Half(1,512,262144,786432) ***************
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: Transpose__663 (Shuffle)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.152432
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1 time 1.10583
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.152432
[08/16/2021-04:50:13] [V] [TRT] *************** Autotuning format combination: Half(1,3,1536:2,393216) -> Half(1,512,262144:2,524288) ***************
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: Transpose__663 (Shuffle)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.286216
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1 time 2.49006
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.286216
[08/16/2021-04:50:13] [V] [TRT] *************** Autotuning format combination: Half(64,192,1:8,98304) -> Half(1,512,1:8,262144) ***************
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: Transpose__663 (Shuffle)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.652276
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1 time 2.50919
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.652276
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.170324
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.169976
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.169976
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.61142
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.593112
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.593112
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.596988
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.558364
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.558364
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.206664
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.162412
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.162412
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.386268
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.138192
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.138192
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.383568
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.10662
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.10662
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.4084
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.157464
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.157464
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.407296
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.124952
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.124952
[08/16/2021-04:50:13] [V] [TRT] *************** Autotuning format combination: Float(1,512,262144,786432) -> Float(1,1024,1048576,3145728) ***************
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: Resize__21 (Resize)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1 time 0.968404
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 1 Time: 0.968404
[08/16/2021-04:50:13] [V] [TRT] *************** Autotuning format combination: Half(1,512,262144,786432) -> Half(1,1024,1048576,3145728) ***************
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: Resize__21 (Resize)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1 time 0.903536
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 1 Time: 0.903536
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:13] [V] [TRT] Tactic: 1002 time 0.660736
[08/16/2021-04:50:13] [V] [TRT] Tactic: 0 time 0.644876
[08/16/2021-04:50:13] [V] [TRT] Fastest Tactic: 0 Time: 0.644876
[08/16/2021-04:50:13] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:14] [V] [TRT] Tactic: 1002 time 6.99122
[08/16/2021-04:50:14] [V] [TRT] Tactic: 0 time 0.494112
[08/16/2021-04:50:14] [V] [TRT] Fastest Tactic: 0 Time: 0.494112
[08/16/2021-04:50:14] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:14] [V] [TRT] Tactic: 1002 time 8.57436
[08/16/2021-04:50:14] [V] [TRT] Tactic: 0 time 0.545676
[08/16/2021-04:50:14] [V] [TRT] Fastest Tactic: 0 Time: 0.545676
[08/16/2021-04:50:14] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:14] [V] [TRT] Tactic: 1002 time 8.57535
[08/16/2021-04:50:14] [V] [TRT] Tactic: 0 time 0.62852
[08/16/2021-04:50:14] [V] [TRT] Fastest Tactic: 0 Time: 0.62852
[08/16/2021-04:50:14] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:14] [V] [TRT] Tactic: 1002 time 0.76468
[08/16/2021-04:50:14] [V] [TRT] Tactic: 0 time 0.629136
[08/16/2021-04:50:14] [V] [TRT] Fastest Tactic: 0 Time: 0.629136
[08/16/2021-04:50:14] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:14] [V] [TRT] Tactic: 1002 time 7.024
[08/16/2021-04:50:14] [V] [TRT] Tactic: 0 time 0.425956
[08/16/2021-04:50:14] [V] [TRT] Fastest Tactic: 0 Time: 0.425956
[08/16/2021-04:50:14] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:14] [V] [TRT] Tactic: 1002 time 8.60626
[08/16/2021-04:50:14] [V] [TRT] Tactic: 0 time 0.542796
[08/16/2021-04:50:14] [V] [TRT] Fastest Tactic: 0 Time: 0.542796
[08/16/2021-04:50:14] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:14] [V] [TRT] Tactic: 1002 time 8.60583
[08/16/2021-04:50:14] [V] [TRT] Tactic: 0 time 0.557356
[08/16/2021-04:50:14] [V] [TRT] Fastest Tactic: 0 Time: 0.557356
[08/16/2021-04:50:14] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:14] [V] [TRT] Tactic: 1002 time 1.52028
[08/16/2021-04:50:14] [V] [TRT] Tactic: 0 time 0.541768
[08/16/2021-04:50:14] [V] [TRT] Fastest Tactic: 0 Time: 0.541768
[08/16/2021-04:50:14] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:14] [V] [TRT] Tactic: 1002 time 1.51005
[08/16/2021-04:50:14] [V] [TRT] Tactic: 0 time 0.404164
[08/16/2021-04:50:14] [V] [TRT] Fastest Tactic: 0 Time: 0.404164
[08/16/2021-04:50:14] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:15] [V] [TRT] Tactic: 1002 time 8.5827
[08/16/2021-04:50:15] [V] [TRT] Tactic: 0 time 0.801976
[08/16/2021-04:50:15] [V] [TRT] Fastest Tactic: 0 Time: 0.801976
[08/16/2021-04:50:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:15] [V] [TRT] Tactic: 1002 time 8.57883
[08/16/2021-04:50:15] [V] [TRT] Tactic: 0 time 0.599012
[08/16/2021-04:50:15] [V] [TRT] Fastest Tactic: 0 Time: 0.599012
[08/16/2021-04:50:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:15] [V] [TRT] Tactic: 1002 time 1.60658
[08/16/2021-04:50:15] [V] [TRT] Tactic: 0 time 0.789036
[08/16/2021-04:50:15] [V] [TRT] Fastest Tactic: 0 Time: 0.789036
[08/16/2021-04:50:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:15] [V] [TRT] Tactic: 1002 time 1.60846
[08/16/2021-04:50:15] [V] [TRT] Tactic: 0 time 0.655232
[08/16/2021-04:50:15] [V] [TRT] Fastest Tactic: 0 Time: 0.655232
[08/16/2021-04:50:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:15] [V] [TRT] Tactic: 1002 time 8.5427
[08/16/2021-04:50:15] [V] [TRT] Tactic: 0 time 1.25629
[08/16/2021-04:50:15] [V] [TRT] Fastest Tactic: 0 Time: 1.25629
[08/16/2021-04:50:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:15] [V] [TRT] Tactic: 1002 time 6.96862
[08/16/2021-04:50:15] [V] [TRT] Tactic: 0 time 1.44178
[08/16/2021-04:50:15] [V] [TRT] Fastest Tactic: 0 Time: 1.44178
[08/16/2021-04:50:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:15] [V] [TRT] Tactic: 1002 time 1.67839
[08/16/2021-04:50:15] [V] [TRT] Tactic: 0 time 0.618332
[08/16/2021-04:50:15] [V] [TRT] Fastest Tactic: 0 Time: 0.618332
[08/16/2021-04:50:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:15] [V] [TRT] Tactic: 1002 time 1.65229
[08/16/2021-04:50:15] [V] [TRT] Tactic: 0 time 0.482276
[08/16/2021-04:50:15] [V] [TRT] Fastest Tactic: 0 Time: 0.482276
[08/16/2021-04:50:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:15] [V] [TRT] Tactic: 1002 time 8.55546
[08/16/2021-04:50:15] [V] [TRT] Tactic: 0 time 0.527688
[08/16/2021-04:50:15] [V] [TRT] Fastest Tactic: 0 Time: 0.527688
[08/16/2021-04:50:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:16] [V] [TRT] Tactic: 1002 time 6.98705
[08/16/2021-04:50:16] [V] [TRT] Tactic: 0 time 0.882188
[08/16/2021-04:50:16] [V] [TRT] Fastest Tactic: 0 Time: 0.882188
[08/16/2021-04:50:16] [V] [TRT] *************** Autotuning format combination: Float(1,1024,1048576,3145728) -> Float(1,512,262144,16777216) ***************
[08/16/2021-04:50:16] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:16] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:50:16] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:50:16] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:16] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:16] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:16] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:17] [V] [TRT] Tactic: 1825138533642645384 time 13.4964
[08/16/2021-04:50:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:50:17] [V] [TRT] Tactic: 2842488832350522458 time 6.77887
[08/16/2021-04:50:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:50:17] [V] [TRT] Tactic: 6448355332020552203 time 15.1538
[08/16/2021-04:50:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:17] [V] [TRT] Tactic: -8060443123034038864 time 6.65434
[08/16/2021-04:50:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:17] [V] [TRT] Tactic: -4420849921117327522 time 8.33868
[08/16/2021-04:50:17] [V] [TRT] Fastest Tactic: -8060443123034038864 Time: 6.65434
[08/16/2021-04:50:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:19] [V] [TRT] Tactic: 0 time 15.7048
[08/16/2021-04:50:19] [V] [TRT] Tactic: 2 skipped. Scratch requested: 154140672, available: 16777216
[08/16/2021-04:50:23] [V] [TRT] Tactic: 5 time 296.063
[08/16/2021-04:50:24] [V] [TRT] Tactic: 57 time 12.6195
[08/16/2021-04:50:24] [I] [TRT] Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output.
[08/16/2021-04:50:24] [V] [TRT] Fastest Tactic: 57 Time: 12.6195
[08/16/2021-04:50:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:24] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8060443123034038864
[08/16/2021-04:50:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:24] [V] [TRT] 
[08/16/2021-04:50:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:50:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:50:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:24] [V] [TRT] *************** Autotuning format combination: Half(1,1024,1048576,3145728) -> Half(1,512,262144,16777216) ***************
[08/16/2021-04:50:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:24] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:24] [V] [TRT] Tactic: 0 time 14.2194
[08/16/2021-04:50:24] [V] [TRT] Tactic: 1 time 10.8887
[08/16/2021-04:50:24] [V] [TRT] Tactic: 2 skipped. Scratch requested: 77070336, available: 16777216
[08/16/2021-04:50:29] [V] [TRT] Tactic: 5 time 293.429
[08/16/2021-04:50:29] [V] [TRT] Fastest Tactic: 1 Time: 10.8887
[08/16/2021-04:50:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:50:29] [V] [TRT] 
[08/16/2021-04:50:29] [V] [TRT] *************** Autotuning format combination: Half(1,1024,1048576:2,2097152) -> Half(1,512,262144:2,8388608) ***************
[08/16/2021-04:50:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:50:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:50:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:50:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:50:29] [V] [TRT] Tactic: 1145226902788474763 time 4.66254
[08/16/2021-04:50:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:29] [V] [TRT] Tactic: 2418518597804310654 time 4.68101
[08/16/2021-04:50:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:29] [V] [TRT] Tactic: 8292881859266835088 time 5.29881
[08/16/2021-04:50:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:50:29] [V] [TRT] Tactic: -7448936905981214224 time 5.178
[08/16/2021-04:50:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:29] [V] [TRT] Tactic: -3689982367035295496 time 10.4754
[08/16/2021-04:50:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:50:30] [V] [TRT] Tactic: -245090590808296743 time 10.6246
[08/16/2021-04:50:30] [V] [TRT] Fastest Tactic: 1145226902788474763 Time: 4.66254
[08/16/2021-04:50:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:30] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1145226902788474763
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:50:30] [V] [TRT] 
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:50:30] [V] [TRT] *************** Autotuning format combination: Half(1,1024,1:4,1048576) -> Half(8,4096,1:8,2097152) ***************
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 () Set Tactic Name: volta_first_layer_filter7x7_fwd
[08/16/2021-04:50:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 () Set Tactic Name: volta_first_layer_filter7x7_fwd
[08/16/2021-04:50:30] [V] [TRT] Tactic: -8357652348141719927 time 1.80142
[08/16/2021-04:50:30] [V] [TRT] Fastest Tactic: -8357652348141719927 Time: 1.80142
[08/16/2021-04:50:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:30] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8357652348141719927
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 () Set Tactic Name: volta_first_layer_filter7x7_fwd
[08/16/2021-04:50:30] [V] [TRT] 
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 () Set Tactic Name: volta_first_layer_filter7x7_fwd
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 () Set Tactic Name: volta_first_layer_filter7x7_fwd
[08/16/2021-04:50:30] [V] [TRT] *************** Autotuning format combination: Half(1,1024,1:8,1048576) -> Float(1,512,262144,16777216) ***************
[08/16/2021-04:50:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:30] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:30] [V] [TRT] *************** Autotuning format combination: Half(1,1024,1:8,1048576) -> Half(8,4096,1:8,2097152) ***************
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:30] [V] [TRT] Tactic: 5925270497649423688 time 18.0791
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:30] [V] [TRT] Tactic: 6680916730816870145 time 21.1724
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:30] [V] [TRT] Tactic: 7158029511300006471 time 10.0077
[08/16/2021-04:50:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:31] [V] [TRT] Tactic: 8283847742354150423 time 19.0686
[08/16/2021-04:50:31] [V] [TRT] Fastest Tactic: 7158029511300006471 Time: 10.0077
[08/16/2021-04:50:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:31] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7158029511300006471
[08/16/2021-04:50:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:31] [V] [TRT] 
[08/16/2021-04:50:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:31] [V] [TRT] Tactic: 1002 time 3.5398
[08/16/2021-04:50:31] [V] [TRT] Tactic: 0 time 3.39616
[08/16/2021-04:50:31] [V] [TRT] Fastest Tactic: 0 Time: 3.39616
[08/16/2021-04:50:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:31] [V] [TRT] Tactic: 1002 time 6.90009
[08/16/2021-04:50:31] [V] [TRT] Tactic: 0 time 2.35812
[08/16/2021-04:50:31] [V] [TRT] Fastest Tactic: 0 Time: 2.35812
[08/16/2021-04:50:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:31] [V] [TRT] Tactic: 1002 time 4.38076
[08/16/2021-04:50:31] [V] [TRT] Tactic: 0 time 2.16521
[08/16/2021-04:50:31] [V] [TRT] Fastest Tactic: 0 Time: 2.16521
[08/16/2021-04:50:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:31] [V] [TRT] Tactic: 1002 time 4.22456
[08/16/2021-04:50:31] [V] [TRT] Tactic: 0 time 3.32594
[08/16/2021-04:50:31] [V] [TRT] Fastest Tactic: 0 Time: 3.32594
[08/16/2021-04:50:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:31] [V] [TRT] Tactic: 1002 time 6.91153
[08/16/2021-04:50:32] [V] [TRT] Tactic: 0 time 1.74284
[08/16/2021-04:50:32] [V] [TRT] Fastest Tactic: 0 Time: 1.74284
[08/16/2021-04:50:32] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:32] [V] [TRT] Tactic: 1002 time 4.55641
[08/16/2021-04:50:32] [V] [TRT] Tactic: 0 time 1.59089
[08/16/2021-04:50:32] [V] [TRT] Fastest Tactic: 0 Time: 1.59089
[08/16/2021-04:50:32] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:32] [V] [TRT] Tactic: 1002 time 8.04923
[08/16/2021-04:50:32] [V] [TRT] Tactic: 0 time 2.82874
[08/16/2021-04:50:32] [V] [TRT] Fastest Tactic: 0 Time: 2.82874
[08/16/2021-04:50:32] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:32] [V] [TRT] Tactic: 1002 time 8.01974
[08/16/2021-04:50:32] [V] [TRT] Tactic: 0 time 2.12694
[08/16/2021-04:50:32] [V] [TRT] Fastest Tactic: 0 Time: 2.12694
[08/16/2021-04:50:32] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:32] [V] [TRT] Tactic: 1002 time 4.50374
[08/16/2021-04:50:32] [V] [TRT] Tactic: 0 time 1.65013
[08/16/2021-04:50:32] [V] [TRT] Fastest Tactic: 0 Time: 1.65013
[08/16/2021-04:50:32] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:32] [V] [TRT] Tactic: 1002 time 4.4328
[08/16/2021-04:50:32] [V] [TRT] Tactic: 0 time 2.16144
[08/16/2021-04:50:32] [V] [TRT] Fastest Tactic: 0 Time: 2.16144
[08/16/2021-04:50:32] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:32] [V] [TRT] Tactic: 1002 time 4.3784
[08/16/2021-04:50:32] [V] [TRT] Tactic: 0 time 1.41754
[08/16/2021-04:50:32] [V] [TRT] Fastest Tactic: 0 Time: 1.41754
[08/16/2021-04:50:32] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:32] [V] [TRT] Tactic: 1002 time 6.80365
[08/16/2021-04:50:33] [V] [TRT] Tactic: 0 time 1.41212
[08/16/2021-04:50:33] [V] [TRT] Fastest Tactic: 0 Time: 1.41212
[08/16/2021-04:50:33] [V] [TRT] *************** Autotuning format combination: Float(1,512,262144,16777216) -> Float(1,256,65536,4194304) ***************
[08/16/2021-04:50:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool (Pooling)
[08/16/2021-04:50:33] [V] [TRT] Tactic: -1 skipped. Scratch requested: 67371520, available: 16777216
[08/16/2021-04:50:33] [V] [TRT] Fastest Tactic: -3360065831133338131 Time: 3.40282e+38
[08/16/2021-04:50:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool (TiledPooling)
[08/16/2021-04:50:33] [V] [TRT] Tactic: 257 time 4.24502
[08/16/2021-04:50:33] [V] [TRT] Tactic: 65793 time 3.5733
[08/16/2021-04:50:33] [V] [TRT] Tactic: 131329 time 3.59907
[08/16/2021-04:50:33] [V] [TRT] Tactic: 196865 time 3.78281
[08/16/2021-04:50:33] [V] [TRT] Tactic: 262401 time 3.11049
[08/16/2021-04:50:33] [V] [TRT] Tactic: 327937 time 3.47794
[08/16/2021-04:50:33] [V] [TRT] Tactic: 393473 time 3.51309
[08/16/2021-04:50:33] [V] [TRT] Tactic: 459009 time 4.41458
[08/16/2021-04:50:33] [V] [TRT] Tactic: 524545 time 3.74599
[08/16/2021-04:50:33] [V] [TRT] Tactic: 590081 time 3.01166
[08/16/2021-04:50:33] [V] [TRT] Tactic: 655617 time 2.38837
[08/16/2021-04:50:33] [V] [TRT] Tactic: 721153 time 2.14556
[08/16/2021-04:50:33] [V] [TRT] Tactic: 786689 time 2.46302
[08/16/2021-04:50:34] [V] [TRT] Tactic: 852225 time 2.50516
[08/16/2021-04:50:34] [V] [TRT] Tactic: 917761 time 4.53022
[08/16/2021-04:50:34] [V] [TRT] Tactic: 983297 time 3.81921
[08/16/2021-04:50:34] [V] [TRT] Tactic: 1048833 time 3.06512
[08/16/2021-04:50:34] [V] [TRT] Tactic: 1114369 time 2.13603
[08/16/2021-04:50:34] [V] [TRT] Tactic: 1179905 time 2.02137
[08/16/2021-04:50:34] [V] [TRT] Tactic: 1245441 time 2.3709
[08/16/2021-04:50:34] [V] [TRT] Tactic: 1310977 time 2.40704
[08/16/2021-04:50:34] [V] [TRT] Tactic: 1376513 time 4.58714
[08/16/2021-04:50:34] [V] [TRT] Tactic: 1442049 time 3.9068
[08/16/2021-04:50:34] [V] [TRT] Tactic: 1507585 time 3.1175
[08/16/2021-04:50:34] [V] [TRT] Tactic: 1573121 time 2.0142
[08/16/2021-04:50:34] [V] [TRT] Tactic: 1638657 time 1.98991
[08/16/2021-04:50:34] [V] [TRT] Tactic: 1704193 time 2.36074
[08/16/2021-04:50:35] [V] [TRT] Tactic: 1769729 time 2.4007
[08/16/2021-04:50:35] [V] [TRT] Tactic: 1835265 time 4.77201
[08/16/2021-04:50:35] [V] [TRT] Tactic: 1900801 time 4.02431
[08/16/2021-04:50:35] [V] [TRT] Tactic: 1966337 time 3.14302
[08/16/2021-04:50:35] [V] [TRT] Tactic: 2031873 time 2.00047
[08/16/2021-04:50:35] [V] [TRT] Tactic: 2097409 time 1.97734
[08/16/2021-04:50:35] [V] [TRT] Tactic: 2162945 time 2.36728
[08/16/2021-04:50:35] [V] [TRT] Tactic: 2228481 time 2.42014
[08/16/2021-04:50:35] [V] [TRT] Tactic: 2294017 time 4.77918
[08/16/2021-04:50:35] [V] [TRT] Tactic: 2359553 time 4.08148
[08/16/2021-04:50:35] [V] [TRT] Tactic: 2425089 time 3.17177
[08/16/2021-04:50:35] [V] [TRT] Tactic: 2490625 time 2.001
[08/16/2021-04:50:35] [V] [TRT] Tactic: 2556161 time 1.98921
[08/16/2021-04:50:35] [V] [TRT] Tactic: 2621697 time 2.38011
[08/16/2021-04:50:35] [V] [TRT] Tactic: 2687233 time 2.43759
[08/16/2021-04:50:36] [V] [TRT] Tactic: 6947073 time 1.75811
[08/16/2021-04:50:36] [V] [TRT] Fastest Tactic: 6947073 Time: 1.75811
[08/16/2021-04:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 6947073
[08/16/2021-04:50:36] [V] [TRT] 
[08/16/2021-04:50:36] [V] [TRT] *************** Autotuning format combination: Half(1,512,262144,16777216) -> Half(1,256,65536,4194304) ***************
[08/16/2021-04:50:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool (Pooling)
[08/16/2021-04:50:36] [V] [TRT] Tactic: -1 skipped. Scratch requested: 33686016, available: 16777216
[08/16/2021-04:50:36] [V] [TRT] Fastest Tactic: -3360065831133338131 Time: 3.40282e+38
[08/16/2021-04:50:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool (TiledPooling)
[08/16/2021-04:50:36] [V] [TRT] TiledPooling has no valid tactics for this config, skipping
[08/16/2021-04:50:36] [V] [TRT] *************** Autotuning format combination: Half(1,512,262144:2,8388608) -> Half(1,256,65536:2,2097152) ***************
[08/16/2021-04:50:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool (Pooling)
[08/16/2021-04:50:36] [V] [TRT] Tactic: -3 time 1.0674
[08/16/2021-04:50:36] [V] [TRT] Fastest Tactic: -3 Time: 1.0674
[08/16/2021-04:50:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool (TiledPooling)
[08/16/2021-04:50:36] [V] [TRT] Tactic: 257 time 2.10168
[08/16/2021-04:50:36] [V] [TRT] Tactic: 65793 time 1.77996
[08/16/2021-04:50:36] [V] [TRT] Tactic: 131329 time 1.88616
[08/16/2021-04:50:36] [V] [TRT] Tactic: 196865 time 2.04427
[08/16/2021-04:50:36] [V] [TRT] Tactic: 262401 time 1.66004
[08/16/2021-04:50:36] [V] [TRT] Tactic: 327937 time 1.82426
[08/16/2021-04:50:36] [V] [TRT] Tactic: 393473 time 1.86668
[08/16/2021-04:50:36] [V] [TRT] Tactic: 459009 time 2.15924
[08/16/2021-04:50:36] [V] [TRT] Tactic: 524545 time 1.83844
[08/16/2021-04:50:36] [V] [TRT] Tactic: 590081 time 1.521
[08/16/2021-04:50:36] [V] [TRT] Tactic: 655617 time 1.2604
[08/16/2021-04:50:36] [V] [TRT] Tactic: 721153 time 1.08709
[08/16/2021-04:50:36] [V] [TRT] Tactic: 786689 time 1.23145
[08/16/2021-04:50:36] [V] [TRT] Tactic: 852225 time 1.26154
[08/16/2021-04:50:36] [V] [TRT] Tactic: 917761 time 2.22555
[08/16/2021-04:50:36] [V] [TRT] Tactic: 983297 time 1.88992
[08/16/2021-04:50:36] [V] [TRT] Tactic: 1048833 time 1.49814
[08/16/2021-04:50:36] [V] [TRT] Tactic: 1114369 time 1.10208
[08/16/2021-04:50:36] [V] [TRT] Tactic: 1179905 time 1.01324
[08/16/2021-04:50:37] [V] [TRT] Tactic: 1245441 time 1.17849
[08/16/2021-04:50:37] [V] [TRT] Tactic: 1310977 time 1.20319
[08/16/2021-04:50:37] [V] [TRT] Tactic: 1376513 time 2.27504
[08/16/2021-04:50:37] [V] [TRT] Tactic: 1442049 time 1.93724
[08/16/2021-04:50:37] [V] [TRT] Tactic: 1507585 time 1.50642
[08/16/2021-04:50:37] [V] [TRT] Tactic: 1573121 time 1.03128
[08/16/2021-04:50:37] [V] [TRT] Tactic: 1638657 time 0.99438
[08/16/2021-04:50:37] [V] [TRT] Tactic: 1704193 time 1.17114
[08/16/2021-04:50:37] [V] [TRT] Tactic: 1769729 time 1.1905
[08/16/2021-04:50:37] [V] [TRT] Tactic: 1835265 time 2.30219
[08/16/2021-04:50:37] [V] [TRT] Tactic: 1900801 time 1.96773
[08/16/2021-04:50:37] [V] [TRT] Tactic: 1966337 time 1.53942
[08/16/2021-04:50:37] [V] [TRT] Tactic: 2031873 time 1.02435
[08/16/2021-04:50:37] [V] [TRT] Tactic: 2097409 time 0.986496
[08/16/2021-04:50:37] [V] [TRT] Tactic: 2162945 time 1.17413
[08/16/2021-04:50:37] [V] [TRT] Tactic: 2228481 time 1.19748
[08/16/2021-04:50:37] [V] [TRT] Tactic: 2294017 time 2.32937
[08/16/2021-04:50:37] [V] [TRT] Tactic: 2359553 time 1.99154
[08/16/2021-04:50:37] [V] [TRT] Tactic: 2425089 time 1.54373
[08/16/2021-04:50:37] [V] [TRT] Tactic: 2490625 time 1.01579
[08/16/2021-04:50:37] [V] [TRT] Tactic: 2556161 time 0.98592
[08/16/2021-04:50:37] [V] [TRT] Tactic: 2621697 time 1.18627
[08/16/2021-04:50:37] [V] [TRT] Tactic: 2687233 time 1.20354
[08/16/2021-04:50:38] [V] [TRT] Tactic: 6947073 time 0.88648
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 6947073 Time: 0.88648
[08/16/2021-04:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 6947073
[08/16/2021-04:50:38] [V] [TRT] 
[08/16/2021-04:50:38] [V] [TRT] *************** Autotuning format combination: Half(8,4096,1:8,2097152) -> Half(8,2048,1:8,524288) ***************
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool (Pooling)
[08/16/2021-04:50:38] [V] [TRT] Tactic: -2 time 0.895156
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: -2 Time: 0.895156
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/pool1_pool/MaxPool (TiledPooling)
[08/16/2021-04:50:38] [V] [TRT] TiledPooling has no valid tactics for this config, skipping
[08/16/2021-04:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -2
[08/16/2021-04:50:38] [V] [TRT] 
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 0.94772
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.856648
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.856648
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 1.72786
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.55196
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.55196
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 1.10627
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.545284
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.545284
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 1.02998
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.83686
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.83686
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 1.72706
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.44048
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.44048
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 1.11221
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.407568
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.407568
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 2.01476
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.629028
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.629028
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 2.00082
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.416948
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.416948
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 1.10012
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.418188
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.418188
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 1.11704
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.542056
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.542056
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 1.10189
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.3638
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.3638
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 1.72191
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.357352
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.357352
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 0.877212
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.856976
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.856976
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 1.72373
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.546596
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.546596
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 1.10636
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.54884
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.54884
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 1.03735
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.836444
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.836444
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 1.7275
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.440164
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.440164
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 1.10941
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.409288
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.409288
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 2.00287
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.631292
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.631292
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 2.0014
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.416196
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.416196
[08/16/2021-04:50:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:38] [V] [TRT] Tactic: 1002 time 1.09873
[08/16/2021-04:50:38] [V] [TRT] Tactic: 0 time 0.415208
[08/16/2021-04:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.415208
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:39] [V] [TRT] Tactic: 1002 time 1.11705
[08/16/2021-04:50:39] [V] [TRT] Tactic: 0 time 0.567992
[08/16/2021-04:50:39] [V] [TRT] Fastest Tactic: 0 Time: 0.567992
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:39] [V] [TRT] Tactic: 1002 time 1.24341
[08/16/2021-04:50:39] [V] [TRT] Tactic: 0 time 0.382468
[08/16/2021-04:50:39] [V] [TRT] Fastest Tactic: 0 Time: 0.382468
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:39] [V] [TRT] Tactic: 1002 time 1.72409
[08/16/2021-04:50:39] [V] [TRT] Tactic: 0 time 0.361456
[08/16/2021-04:50:39] [V] [TRT] Fastest Tactic: 0 Time: 0.361456
[08/16/2021-04:50:39] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,4194304) -> Float(1,256,65536,4194304) ***************
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: 1754569683116234317 time 1.5745
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: 1825138533642645384 time 1.56575
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: 2733356012094739613 time 1.19409
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: 3915320020053085238 time 1.57562
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: 6808617066150061604 time 0.824456
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: 9091006216302412844 time 0.822128
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: -8060443123034038864 time 0.840588
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: -4420849921117327522 time 1.35433
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: -3946921629105938337 time 1.16257
[08/16/2021-04:50:39] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.822128
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:39] [V] [TRT] Tactic: 0 time 2.67256
[08/16/2021-04:50:39] [V] [TRT] Tactic: 2 time 3.5389
[08/16/2021-04:50:39] [V] [TRT] Tactic: 5 skipped. Scratch requested: 38043648, available: 16777216
[08/16/2021-04:50:39] [V] [TRT] Tactic: 57 time 2.28839
[08/16/2021-04:50:39] [V] [TRT] Fastest Tactic: 57 Time: 2.28839
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] 
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,4194304) -> Half(1,256,65536,4194304) ***************
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:39] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:39] [V] [TRT] Tactic: 0 time 2.26177
[08/16/2021-04:50:39] [V] [TRT] Tactic: 1 time 1.80886
[08/16/2021-04:50:39] [V] [TRT] Tactic: 2 time 2.65084
[08/16/2021-04:50:39] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2198093824, available: 16777216
[08/16/2021-04:50:39] [V] [TRT] Tactic: 5 skipped. Scratch requested: 38043648, available: 16777216
[08/16/2021-04:50:39] [V] [TRT] Fastest Tactic: 1 Time: 1.80886
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:50:39] [V] [TRT] 
[08/16/2021-04:50:39] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,2097152) -> Half(1,256,65536:2,2097152) ***************
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: 2418518597804310654 time 0.517404
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: 8292881859266835088 time 0.638528
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: 8401509141903434922 time 0.509284
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: -8654297089785671176 time 1.20974
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: -7140760933967189247 time 0.497988
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: -4097850214384059472 time 0.581072
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: -3689982367035295496 time 1.21335
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: -2534402059426524406 time 0.853764
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: -2027588946874785071 time 0.621276
[08/16/2021-04:50:39] [V] [TRT] Fastest Tactic: -7140760933967189247 Time: 0.497988
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:39] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7140760933967189247
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] 
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:50:39] [V] [TRT] *************** Autotuning format combination: Half(8,2048,1:8,524288) -> Float(1,256,65536,4194304) ***************
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:39] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:39] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:39] [V] [TRT] *************** Autotuning format combination: Half(8,2048,1:8,524288) -> Half(8,2048,1:8,524288) ***************
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: 2105695814191699972 time 0.441628
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: 3754069740140581927 time 0.532232
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: 5666160310350604399 time 0.532936
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: 5925270497649423688 time 0.577316
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: 6680916730816870145 time 0.472536
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: 7158029511300006471 time 0.443548
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: 7859952145590271433 time 0.47118
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:39] [V] [TRT] Tactic: 8283847742354150423 time 0.541488
[08/16/2021-04:50:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:40] [V] [TRT] Tactic: -8391760416076885205 time 0.5698
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:40] [V] [TRT] Tactic: -4534876761957424274 time 0.5723
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:40] [V] [TRT] Tactic: -3237051169894153788 time 0.443236
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:40] [V] [TRT] Tactic: -2422160065350346448 time 0.464568
[08/16/2021-04:50:40] [V] [TRT] Fastest Tactic: 2105695814191699972 Time: 0.441628
[08/16/2021-04:50:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:40] [V] [TRT] Tactic: 0 time 3.10388
[08/16/2021-04:50:40] [V] [TRT] Tactic: 1 time 4.71975
[08/16/2021-04:50:40] [V] [TRT] Tactic: 2 skipped. Scratch requested: 16777728, available: 16777216
[08/16/2021-04:50:40] [V] [TRT] Fastest Tactic: 0 Time: 3.10388
[08/16/2021-04:50:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2105695814191699972
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:40] [V] [TRT] 
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:40] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,4194304) -> Float(1,256,65536,4194304) ***************
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:50:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:40] [V] [TRT] Tactic: 1825138533642645384 time 11.7248
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:50:40] [V] [TRT] Tactic: 2842488832350522458 time 5.9976
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:40] [V] [TRT] Tactic: 3915320020053085238 time 11.663
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:50:40] [V] [TRT] Tactic: 6448355332020552203 time 12.4259
[08/16/2021-04:50:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:50:41] [V] [TRT] Tactic: 6808617066150061604 time 6.05792
[08/16/2021-04:50:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:41] [V] [TRT] Tactic: -8060443123034038864 time 6.09165
[08/16/2021-04:50:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:41] [V] [TRT] Tactic: -4420849921117327522 time 6.75459
[08/16/2021-04:50:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:50:41] [V] [TRT] Tactic: -3946921629105938337 time 6.53037
[08/16/2021-04:50:41] [V] [TRT] Fastest Tactic: 2842488832350522458 Time: 5.9976
[08/16/2021-04:50:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:41] [V] [TRT] Tactic: 0 time 10.3973
[08/16/2021-04:50:41] [V] [TRT] Tactic: 2 skipped. Scratch requested: 150994944, available: 16777216
[08/16/2021-04:50:41] [V] [TRT] Tactic: 5 skipped. Scratch requested: 18939904, available: 16777216
[08/16/2021-04:50:41] [V] [TRT] Tactic: 6 time 4.94721
[08/16/2021-04:50:41] [V] [TRT] Tactic: 57 time 8.06236
[08/16/2021-04:50:41] [V] [TRT] Fastest Tactic: 6 Time: 4.94721
[08/16/2021-04:50:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6
[08/16/2021-04:50:41] [V] [TRT] 
[08/16/2021-04:50:41] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,4194304) -> Half(1,256,65536,4194304) ***************
[08/16/2021-04:50:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:42] [V] [TRT] Tactic: 0 time 10.6466
[08/16/2021-04:50:42] [V] [TRT] Tactic: 1 time 7.67129
[08/16/2021-04:50:42] [V] [TRT] Tactic: 2 skipped. Scratch requested: 75497472, available: 16777216
[08/16/2021-04:50:42] [V] [TRT] Tactic: 5 skipped. Scratch requested: 18939904, available: 16777216
[08/16/2021-04:50:42] [V] [TRT] Tactic: 6 skipped. Scratch requested: 34112000, available: 16777216
[08/16/2021-04:50:42] [V] [TRT] Fastest Tactic: 1 Time: 7.67129
[08/16/2021-04:50:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:50:42] [V] [TRT] 
[08/16/2021-04:50:42] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,2097152) -> Half(1,256,65536:2,2097152) ***************
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:50:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:42] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:50:42] [V] [TRT] Tactic: 1145226902788474763 time 3.11232
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:42] [V] [TRT] Tactic: 2418518597804310654 time 3.12679
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:42] [V] [TRT] Tactic: 8292881859266835088 time 3.41432
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:42] [V] [TRT] Tactic: 8401509141903434922 time 3.08708
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:50:42] [V] [TRT] Tactic: -8654297089785671176 time 6.41224
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:50:42] [V] [TRT] Tactic: -7448936905981214224 time 3.36674
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:42] [V] [TRT] Tactic: -3689982367035295496 time 6.41127
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:50:42] [V] [TRT] Tactic: -2027588946874785071 time 3.27852
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:50:42] [V] [TRT] Tactic: -245090590808296743 time 6.51111
[08/16/2021-04:50:42] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 3.08708
[08/16/2021-04:50:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:42] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:42] [V] [TRT] 
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:42] [V] [TRT] *************** Autotuning format combination: Half(8,2048,1:8,524288) -> Float(1,256,65536,4194304) ***************
[08/16/2021-04:50:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:42] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:42] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:42] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:42] [V] [TRT] *************** Autotuning format combination: Half(8,2048,1:8,524288) -> Half(8,2048,1:8,524288) ***************
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:42] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:42] [V] [TRT] Tactic: 3754069740140581927 time 1.85844
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:42] [V] [TRT] Tactic: 5925270497649423688 time 1.92982
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:42] [V] [TRT] Tactic: 6680916730816870145 time 1.30284
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:42] [V] [TRT] Tactic: 7158029511300006471 time 1.11336
[08/16/2021-04:50:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:43] [V] [TRT] Tactic: 7859952145590271433 time 1.27779
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:43] [V] [TRT] Tactic: 8283847742354150423 time 1.85681
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:43] [V] [TRT] Tactic: -4534876761957424274 time 1.93827
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:43] [V] [TRT] Tactic: -3237051169894153788 time 1.11722
[08/16/2021-04:50:43] [V] [TRT] Fastest Tactic: 7158029511300006471 Time: 1.11336
[08/16/2021-04:50:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:43] [V] [TRT] Tactic: 0 time 17.418
[08/16/2021-04:50:43] [V] [TRT] Tactic: 1 skipped. Scratch requested: 17244672, available: 16777216
[08/16/2021-04:50:43] [V] [TRT] Tactic: 2 skipped. Scratch requested: 83886592, available: 16777216
[08/16/2021-04:50:43] [V] [TRT] Tactic: 6 skipped. Scratch requested: 34112000, available: 16777216
[08/16/2021-04:50:43] [V] [TRT] Fastest Tactic: 0 Time: 17.418
[08/16/2021-04:50:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:43] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7158029511300006471
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:43] [V] [TRT] 
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:43] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,4194304) -> Float(1,256,65536,16777216) ***************
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:50:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (FusedConvActConvolution)
[08/16/2021-04:50:43] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (CaskConvolution)
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:50:43] [V] [TRT] Tactic: 1754569683116234317 time 3.41935
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:43] [V] [TRT] Tactic: 1825138533642645384 time 3.43574
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:50:43] [V] [TRT] Tactic: 2733356012094739613 time 4.70464
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:43] [V] [TRT] Tactic: 3915320020053085238 time 3.40708
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:50:43] [V] [TRT] Tactic: 6808617066150061604 time 3.24937
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:43] [V] [TRT] Tactic: 9091006216302412844 time 3.21644
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:43] [V] [TRT] Tactic: -8060443123034038864 time 3.28335
[08/16/2021-04:50:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:44] [V] [TRT] Tactic: -4420849921117327522 time 5.38242
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:50:44] [V] [TRT] Tactic: -3946921629105938337 time 4.48576
[08/16/2021-04:50:44] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 3.21644
[08/16/2021-04:50:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (CudaConvolution)
[08/16/2021-04:50:44] [V] [TRT] Tactic: 0 time 7.71239
[08/16/2021-04:50:44] [V] [TRT] Tactic: 2 time 8.53216
[08/16/2021-04:50:44] [V] [TRT] Tactic: 5 skipped. Scratch requested: 24510464, available: 16777216
[08/16/2021-04:50:44] [V] [TRT] Tactic: 57 time 6.11667
[08/16/2021-04:50:44] [V] [TRT] Fastest Tactic: 57 Time: 6.11667
[08/16/2021-04:50:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[08/16/2021-04:50:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:44] [V] [TRT] 
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:44] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,4194304) -> Half(1,256,65536,16777216) ***************
[08/16/2021-04:50:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (FusedConvActConvolution)
[08/16/2021-04:50:44] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (CaskConvolution)
[08/16/2021-04:50:44] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (CudaConvolution)
[08/16/2021-04:50:44] [V] [TRT] Tactic: 0 time 7.15858
[08/16/2021-04:50:44] [V] [TRT] Tactic: 1 time 5.44722
[08/16/2021-04:50:44] [V] [TRT] Tactic: 2 time 6.97904
[08/16/2021-04:50:44] [V] [TRT] Tactic: 4 skipped. Scratch requested: 8690925568, available: 16777216
[08/16/2021-04:50:44] [V] [TRT] Tactic: 5 skipped. Scratch requested: 24510464, available: 16777216
[08/16/2021-04:50:44] [V] [TRT] Fastest Tactic: 1 Time: 5.44722
[08/16/2021-04:50:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[08/16/2021-04:50:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:50:44] [V] [TRT] 
[08/16/2021-04:50:44] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,2097152) -> Half(1,256,65536:2,8388608) ***************
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:50:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (FusedConvActConvolution)
[08/16/2021-04:50:44] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (CaskConvolution)
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:44] [V] [TRT] Tactic: 2418518597804310654 time 1.98498
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:44] [V] [TRT] Tactic: 8292881859266835088 time 2.51192
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:44] [V] [TRT] Tactic: 8401509141903434922 time 1.96716
[08/16/2021-04:50:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:50:45] [V] [TRT] Tactic: -8654297089785671176 time 2.5723
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:50:45] [V] [TRT] Tactic: -7140760933967189247 time 1.93579
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:50:45] [V] [TRT] Tactic: -4097850214384059472 time 2.21287
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:45] [V] [TRT] Tactic: -3689982367035295496 time 2.57865
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:45] [V] [TRT] Tactic: -2534402059426524406 time 1.7327
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:50:45] [V] [TRT] Tactic: -2027588946874785071 time 2.407
[08/16/2021-04:50:45] [V] [TRT] Fastest Tactic: -2534402059426524406 Time: 1.7327
[08/16/2021-04:50:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (CudaConvolution)
[08/16/2021-04:50:45] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[08/16/2021-04:50:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2534402059426524406
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:45] [V] [TRT] 
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:45] [V] [TRT] *************** Autotuning format combination: Half(8,2048,1:8,524288) -> Float(1,256,65536,16777216) ***************
[08/16/2021-04:50:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (FusedConvActConvolution)
[08/16/2021-04:50:45] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (CaskConvolution)
[08/16/2021-04:50:45] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (CudaConvolution)
[08/16/2021-04:50:45] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[08/16/2021-04:50:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:45] [V] [TRT] *************** Autotuning format combination: Half(8,2048,1:8,524288) -> Half(32,8192,1:8,2097152) ***************
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (FusedConvActConvolution)
[08/16/2021-04:50:45] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (CaskConvolution)
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] Tactic: 2105695814191699972 time 1.46354
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] Tactic: 3754069740140581927 time 1.33727
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] Tactic: 5666160310350604399 time 1.33794
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] Tactic: 5925270497649423688 time 1.42184
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] Tactic: 6680916730816870145 time 1.61721
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] Tactic: 7158029511300006471 time 1.43655
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] Tactic: 7859952145590271433 time 1.60801
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] Tactic: 8283847742354150423 time 1.34788
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] Tactic: -8391760416076885205 time 1.40924
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] Tactic: -4534876761957424274 time 1.41751
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] Tactic: -3237051169894153788 time 1.43969
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] Tactic: -2422160065350346448 time 1.58871
[08/16/2021-04:50:45] [V] [TRT] Fastest Tactic: 3754069740140581927 Time: 1.33727
[08/16/2021-04:50:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (CudaConvolution)
[08/16/2021-04:50:45] [V] [TRT] Tactic: 0 time 11.458
[08/16/2021-04:50:45] [V] [TRT] Tactic: 1 skipped. Scratch requested: 42369536, available: 16777216
[08/16/2021-04:50:45] [V] [TRT] Tactic: 2 skipped. Scratch requested: 41943552, available: 16777216
[08/16/2021-04:50:45] [V] [TRT] Fastest Tactic: 0 Time: 11.458
[08/16/2021-04:50:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[08/16/2021-04:50:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3754069740140581927
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] 
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:45] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:45] [V] [TRT] Tactic: 1002 time 3.5636
[08/16/2021-04:50:46] [V] [TRT] Tactic: 0 time 3.39599
[08/16/2021-04:50:46] [V] [TRT] Fastest Tactic: 0 Time: 3.39599
[08/16/2021-04:50:46] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:46] [V] [TRT] Tactic: 1002 time 7.22127
[08/16/2021-04:50:46] [V] [TRT] Tactic: 0 time 2.16407
[08/16/2021-04:50:46] [V] [TRT] Fastest Tactic: 0 Time: 2.16407
[08/16/2021-04:50:46] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:46] [V] [TRT] Tactic: 1002 time 4.36971
[08/16/2021-04:50:46] [V] [TRT] Tactic: 0 time 2.16525
[08/16/2021-04:50:46] [V] [TRT] Fastest Tactic: 0 Time: 2.16525
[08/16/2021-04:50:46] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:46] [V] [TRT] Tactic: 1002 time 4.24115
[08/16/2021-04:50:46] [V] [TRT] Tactic: 0 time 3.3254
[08/16/2021-04:50:46] [V] [TRT] Fastest Tactic: 0 Time: 3.3254
[08/16/2021-04:50:46] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:46] [V] [TRT] Tactic: 1002 time 7.17042
[08/16/2021-04:50:46] [V] [TRT] Tactic: 0 time 1.74266
[08/16/2021-04:50:46] [V] [TRT] Fastest Tactic: 0 Time: 1.74266
[08/16/2021-04:50:46] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:46] [V] [TRT] Tactic: 1002 time 4.41505
[08/16/2021-04:50:46] [V] [TRT] Tactic: 0 time 1.60254
[08/16/2021-04:50:46] [V] [TRT] Fastest Tactic: 0 Time: 1.60254
[08/16/2021-04:50:46] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:46] [V] [TRT] Tactic: 1002 time 8.0184
[08/16/2021-04:50:46] [V] [TRT] Tactic: 0 time 2.52713
[08/16/2021-04:50:46] [V] [TRT] Fastest Tactic: 0 Time: 2.52713
[08/16/2021-04:50:46] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:47] [V] [TRT] Tactic: 1002 time 8.00939
[08/16/2021-04:50:47] [V] [TRT] Tactic: 0 time 1.64738
[08/16/2021-04:50:47] [V] [TRT] Fastest Tactic: 0 Time: 1.64738
[08/16/2021-04:50:47] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:47] [V] [TRT] Tactic: 1002 time 4.35307
[08/16/2021-04:50:47] [V] [TRT] Tactic: 0 time 1.65201
[08/16/2021-04:50:47] [V] [TRT] Fastest Tactic: 0 Time: 1.65201
[08/16/2021-04:50:47] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:47] [V] [TRT] Tactic: 1002 time 4.53146
[08/16/2021-04:50:47] [V] [TRT] Tactic: 0 time 2.20914
[08/16/2021-04:50:47] [V] [TRT] Fastest Tactic: 0 Time: 2.20914
[08/16/2021-04:50:47] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:47] [V] [TRT] Tactic: 1002 time 4.41978
[08/16/2021-04:50:47] [V] [TRT] Tactic: 0 time 1.46585
[08/16/2021-04:50:47] [V] [TRT] Fastest Tactic: 0 Time: 1.46585
[08/16/2021-04:50:47] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:47] [V] [TRT] Tactic: 1002 time 6.91623
[08/16/2021-04:50:47] [V] [TRT] Tactic: 0 time 1.42111
[08/16/2021-04:50:47] [V] [TRT] Fastest Tactic: 0 Time: 1.42111
[08/16/2021-04:50:47] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,4194304), Float(1,256,65536,16777216) -> Float(1,256,65536,16777216) ***************
[08/16/2021-04:50:47] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:50:47] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:47] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:50:47] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:47] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:50:47] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:47] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:47] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:47] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:50:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (CaskConvolution)
[08/16/2021-04:50:47] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:50:47] [V] [TRT] Tactic: 1754569683116234317 time 4.51359
[08/16/2021-04:50:47] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:47] [V] [TRT] Tactic: 1825138533642645384 time 4.67935
[08/16/2021-04:50:47] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:50:47] [V] [TRT] Tactic: 2733356012094739613 time 5.92529
[08/16/2021-04:50:47] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:47] [V] [TRT] Tactic: 3915320020053085238 time 4.54932
[08/16/2021-04:50:47] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:50:48] [V] [TRT] Tactic: 6808617066150061604 time 4.58966
[08/16/2021-04:50:48] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:48] [V] [TRT] Tactic: 9091006216302412844 time 4.56844
[08/16/2021-04:50:48] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:48] [V] [TRT] Tactic: -8060443123034038864 time 4.5833
[08/16/2021-04:50:48] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:48] [V] [TRT] Tactic: -4420849921117327522 time 6.44999
[08/16/2021-04:50:48] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:50:48] [V] [TRT] Tactic: -3946921629105938337 time 5.93059
[08/16/2021-04:50:48] [V] [TRT] Fastest Tactic: 1754569683116234317 Time: 4.51359
[08/16/2021-04:50:48] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (CudaConvolution)
[08/16/2021-04:50:48] [V] [TRT] Tactic: 0 time 14.8645
[08/16/2021-04:50:48] [V] [TRT] Tactic: 2 time 15.6567
[08/16/2021-04:50:48] [V] [TRT] Tactic: 5 skipped. Scratch requested: 24510464, available: 16777216
[08/16/2021-04:50:49] [V] [TRT] Tactic: 57 time 13.2403
[08/16/2021-04:50:49] [V] [TRT] Fastest Tactic: 57 Time: 13.2403
[08/16/2021-04:50:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1754569683116234317
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:50:49] [V] [TRT] 
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:50:49] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,4194304), Half(1,256,65536,16777216) -> Half(1,256,65536,16777216) ***************
[08/16/2021-04:50:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (CaskConvolution)
[08/16/2021-04:50:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (CudaConvolution)
[08/16/2021-04:50:49] [V] [TRT] Tactic: 0 time 11.1474
[08/16/2021-04:50:49] [V] [TRT] Tactic: 1 time 9.52978
[08/16/2021-04:50:49] [V] [TRT] Tactic: 2 time 10.9774
[08/16/2021-04:50:49] [V] [TRT] Tactic: 4 skipped. Scratch requested: 8690925568, available: 16777216
[08/16/2021-04:50:49] [V] [TRT] Tactic: 5 skipped. Scratch requested: 24510464, available: 16777216
[08/16/2021-04:50:49] [V] [TRT] Fastest Tactic: 1 Time: 9.52978
[08/16/2021-04:50:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:50:49] [V] [TRT] 
[08/16/2021-04:50:49] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,2097152), Half(1,256,65536:2,8388608) -> Half(1,256,65536:2,8388608) ***************
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:50:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (CaskConvolution)
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:49] [V] [TRT] Tactic: 2418518597804310654 time 2.38654
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:49] [V] [TRT] Tactic: 8292881859266835088 time 3.1236
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:49] [V] [TRT] Tactic: 8401509141903434922 time 2.38222
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:50:49] [V] [TRT] Tactic: -8654297089785671176 time 2.93593
[08/16/2021-04:50:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:50:50] [V] [TRT] Tactic: -7140760933967189247 time 2.44365
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:50:50] [V] [TRT] Tactic: -4097850214384059472 time 3.02341
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:50] [V] [TRT] Tactic: -3689982367035295496 time 2.9413
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:50] [V] [TRT] Tactic: -2534402059426524406 time 2.19213
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:50:50] [V] [TRT] Tactic: -2027588946874785071 time 3.15166
[08/16/2021-04:50:50] [V] [TRT] Fastest Tactic: -2534402059426524406 Time: 2.19213
[08/16/2021-04:50:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (CudaConvolution)
[08/16/2021-04:50:50] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2534402059426524406
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:50] [V] [TRT] 
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:50] [V] [TRT] *************** Autotuning format combination: Half(8,2048,1:8,524288), Float(1,256,65536,16777216) -> Float(1,256,65536,16777216) ***************
[08/16/2021-04:50:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (CaskConvolution)
[08/16/2021-04:50:50] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (CudaConvolution)
[08/16/2021-04:50:50] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:50] [V] [TRT] *************** Autotuning format combination: Half(8,2048,1:8,524288), Half(32,8192,1:8,2097152) -> Half(32,8192,1:8,2097152) ***************
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (CaskConvolution)
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] Tactic: 2105695814191699972 time 2.12645
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] Tactic: 3754069740140581927 time 1.95927
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] Tactic: 5666160310350604399 time 1.88244
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] Tactic: 5925270497649423688 time 1.94598
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] Tactic: 6680916730816870145 time 2.39918
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] Tactic: 7158029511300006471 time 2.06598
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] Tactic: 7859952145590271433 time 2.40474
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] Tactic: 8283847742354150423 time 1.98713
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] Tactic: -8391760416076885205 time 1.93431
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] Tactic: -4534876761957424274 time 1.96744
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] Tactic: -3237051169894153788 time 2.06021
[08/16/2021-04:50:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:50] [V] [TRT] Tactic: -2422160065350346448 time 2.37504
[08/16/2021-04:50:50] [V] [TRT] Fastest Tactic: 5666160310350604399 Time: 1.88244
[08/16/2021-04:50:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (CudaConvolution)
[08/16/2021-04:50:51] [V] [TRT] Tactic: 0 time 15.459
[08/16/2021-04:50:51] [V] [TRT] Tactic: 1 skipped. Scratch requested: 42369536, available: 16777216
[08/16/2021-04:50:51] [V] [TRT] Tactic: 2 skipped. Scratch requested: 41943552, available: 16777216
[08/16/2021-04:50:51] [V] [TRT] Fastest Tactic: 0 Time: 15.459
[08/16/2021-04:50:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5666160310350604399
[08/16/2021-04:50:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:51] [V] [TRT] 
[08/16/2021-04:50:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:51] [V] [TRT] Tactic: 1002 time 3.5673
[08/16/2021-04:50:51] [V] [TRT] Tactic: 0 time 3.39808
[08/16/2021-04:50:51] [V] [TRT] Fastest Tactic: 0 Time: 3.39808
[08/16/2021-04:50:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:51] [V] [TRT] Tactic: 1002 time 7.19061
[08/16/2021-04:50:51] [V] [TRT] Tactic: 0 time 2.17131
[08/16/2021-04:50:51] [V] [TRT] Fastest Tactic: 0 Time: 2.17131
[08/16/2021-04:50:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:51] [V] [TRT] Tactic: 1002 time 4.36799
[08/16/2021-04:50:51] [V] [TRT] Tactic: 0 time 2.16738
[08/16/2021-04:50:51] [V] [TRT] Fastest Tactic: 0 Time: 2.16738
[08/16/2021-04:50:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:51] [V] [TRT] Tactic: 1002 time 4.28532
[08/16/2021-04:50:51] [V] [TRT] Tactic: 0 time 3.32588
[08/16/2021-04:50:51] [V] [TRT] Fastest Tactic: 0 Time: 3.32588
[08/16/2021-04:50:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:51] [V] [TRT] Tactic: 1002 time 7.16198
[08/16/2021-04:50:51] [V] [TRT] Tactic: 0 time 1.75158
[08/16/2021-04:50:51] [V] [TRT] Fastest Tactic: 0 Time: 1.75158
[08/16/2021-04:50:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:51] [V] [TRT] Tactic: 1002 time 4.40846
[08/16/2021-04:50:51] [V] [TRT] Tactic: 0 time 1.60741
[08/16/2021-04:50:51] [V] [TRT] Fastest Tactic: 0 Time: 1.60741
[08/16/2021-04:50:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:52] [V] [TRT] Tactic: 1002 time 8.03349
[08/16/2021-04:50:52] [V] [TRT] Tactic: 0 time 2.55794
[08/16/2021-04:50:52] [V] [TRT] Fastest Tactic: 0 Time: 2.55794
[08/16/2021-04:50:52] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:52] [V] [TRT] Tactic: 1002 time 8.02371
[08/16/2021-04:50:52] [V] [TRT] Tactic: 0 time 1.64933
[08/16/2021-04:50:52] [V] [TRT] Fastest Tactic: 0 Time: 1.64933
[08/16/2021-04:50:52] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:52] [V] [TRT] Tactic: 1002 time 4.35438
[08/16/2021-04:50:52] [V] [TRT] Tactic: 0 time 1.62926
[08/16/2021-04:50:52] [V] [TRT] Fastest Tactic: 0 Time: 1.62926
[08/16/2021-04:50:52] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:52] [V] [TRT] Tactic: 1002 time 4.53232
[08/16/2021-04:50:52] [V] [TRT] Tactic: 0 time 2.20097
[08/16/2021-04:50:52] [V] [TRT] Fastest Tactic: 0 Time: 2.20097
[08/16/2021-04:50:52] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:52] [V] [TRT] Tactic: 1002 time 4.45878
[08/16/2021-04:50:52] [V] [TRT] Tactic: 0 time 1.43316
[08/16/2021-04:50:52] [V] [TRT] Fastest Tactic: 0 Time: 1.43316
[08/16/2021-04:50:52] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:52] [V] [TRT] Tactic: 1002 time 6.91625
[08/16/2021-04:50:52] [V] [TRT] Tactic: 0 time 1.44173
[08/16/2021-04:50:52] [V] [TRT] Fastest Tactic: 0 Time: 1.44173
[08/16/2021-04:50:52] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,16777216) -> Float(1,256,65536,4194304) ***************
[08/16/2021-04:50:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:50:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:50:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:50:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:50:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:52] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:50:53] [V] [TRT] Tactic: 1754569683116234317 time 5.59222
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:53] [V] [TRT] Tactic: 1825138533642645384 time 5.62016
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:50:53] [V] [TRT] Tactic: 2733356012094739613 time 3.43696
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:53] [V] [TRT] Tactic: 3915320020053085238 time 5.59235
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:50:53] [V] [TRT] Tactic: 6808617066150061604 time 2.76673
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:53] [V] [TRT] Tactic: 9091006216302412844 time 2.67937
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:53] [V] [TRT] Tactic: -8060443123034038864 time 2.8008
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:53] [V] [TRT] Tactic: -4420849921117327522 time 4.04403
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:50:53] [V] [TRT] Tactic: -3946921629105938337 time 3.41594
[08/16/2021-04:50:53] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 2.67937
[08/16/2021-04:50:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:53] [V] [TRT] Tactic: 0 time 5.57246
[08/16/2021-04:50:53] [V] [TRT] Tactic: 2 skipped. Scratch requested: 67108864, available: 16777216
[08/16/2021-04:50:53] [V] [TRT] Tactic: 5 skipped. Scratch requested: 24510464, available: 16777216
[08/16/2021-04:50:53] [V] [TRT] Tactic: 57 time 4.2294
[08/16/2021-04:50:53] [V] [TRT] Fastest Tactic: 57 Time: 4.2294
[08/16/2021-04:50:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:53] [V] [TRT] 
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:53] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,16777216) -> Half(1,256,65536,4194304) ***************
[08/16/2021-04:50:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:53] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:53] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:53] [V] [TRT] Tactic: 0 time 5.28362
[08/16/2021-04:50:53] [V] [TRT] Tactic: 1 time 3.82743
[08/16/2021-04:50:53] [V] [TRT] Tactic: 2 skipped. Scratch requested: 33554432, available: 16777216
[08/16/2021-04:50:53] [V] [TRT] Tactic: 4 skipped. Scratch requested: 8792375296, available: 16777216
[08/16/2021-04:50:53] [V] [TRT] Tactic: 5 skipped. Scratch requested: 24510464, available: 16777216
[08/16/2021-04:50:53] [V] [TRT] Fastest Tactic: 1 Time: 3.82743
[08/16/2021-04:50:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:50:53] [V] [TRT] 
[08/16/2021-04:50:53] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,8388608) -> Half(1,256,65536:2,2097152) ***************
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:50:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:53] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: 2418518597804310654 time 1.45016
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: 8292881859266835088 time 1.87206
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: 8401509141903434922 time 1.42944
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: -8654297089785671176 time 3.14613
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: -7140760933967189247 time 1.41155
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: -4097850214384059472 time 1.65673
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: -3689982367035295496 time 3.14564
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: -2534402059426524406 time 2.75689
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: -2027588946874785071 time 1.77713
[08/16/2021-04:50:54] [V] [TRT] Fastest Tactic: -7140760933967189247 Time: 1.41155
[08/16/2021-04:50:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:54] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:54] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7140760933967189247
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:50:54] [V] [TRT] 
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:50:54] [V] [TRT] *************** Autotuning format combination: Half(32,8192,1:8,2097152) -> Float(1,256,65536,4194304) ***************
[08/16/2021-04:50:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:54] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:54] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:54] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:54] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:54] [V] [TRT] *************** Autotuning format combination: Half(32,8192,1:8,2097152) -> Half(8,2048,1:8,524288) ***************
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:54] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: 2105695814191699972 time 1.04398
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: 3754069740140581927 time 1.12838
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: 5666160310350604399 time 1.12153
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: 5925270497649423688 time 1.25918
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: 6680916730816870145 time 0.946036
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: 7158029511300006471 time 1.03476
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: 7859952145590271433 time 0.963244
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: 8283847742354150423 time 1.12624
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: -8391760416076885205 time 1.25103
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: -4534876761957424274 time 1.26884
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: -3237051169894153788 time 1.03388
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] Tactic: -2422160065350346448 time 0.931492
[08/16/2021-04:50:54] [V] [TRT] Fastest Tactic: -2422160065350346448 Time: 0.931492
[08/16/2021-04:50:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:54] [V] [TRT] Tactic: 0 time 8.7342
[08/16/2021-04:50:54] [V] [TRT] Tactic: 1 skipped. Scratch requested: 42369536, available: 16777216
[08/16/2021-04:50:54] [V] [TRT] Tactic: 2 skipped. Scratch requested: 41943552, available: 16777216
[08/16/2021-04:50:54] [V] [TRT] Fastest Tactic: 0 Time: 8.7342
[08/16/2021-04:50:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:54] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2422160065350346448
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] 
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:54] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,4194304) -> Float(1,256,65536,4194304) ***************
[08/16/2021-04:50:54] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,4194304) -> Half(1,256,65536,4194304) ***************
[08/16/2021-04:50:54] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,2097152) -> Half(1,256,65536:2,2097152) ***************
[08/16/2021-04:50:54] [V] [TRT] *************** Autotuning format combination: Half(8,2048,1:8,524288) -> Float(1,256,65536,4194304) ***************
[08/16/2021-04:50:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:54] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:54] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:54] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:54] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:54] [V] [TRT] *************** Autotuning format combination: Half(8,2048,1:8,524288) -> Half(8,2048,1:8,524288) ***************
[08/16/2021-04:50:55] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,4194304), Float(1,256,65536,16777216) -> Float(1,256,65536,16777216) ***************
[08/16/2021-04:50:55] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,4194304), Half(1,256,65536,16777216) -> Half(1,256,65536,16777216) ***************
[08/16/2021-04:50:55] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,2097152), Half(1,256,65536:2,8388608) -> Half(1,256,65536:2,8388608) ***************
[08/16/2021-04:50:55] [V] [TRT] *************** Autotuning format combination: Half(8,2048,1:8,524288), Float(1,256,65536,16777216) -> Float(1,256,65536,16777216) ***************
[08/16/2021-04:50:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_out/Relu6 (CaskConvolution)
[08/16/2021-04:50:55] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_out/Relu6 (CudaConvolution)
[08/16/2021-04:50:55] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:55] [V] [TRT] *************** Autotuning format combination: Half(8,2048,1:8,524288), Half(32,8192,1:8,2097152) -> Half(32,8192,1:8,2097152) ***************
[08/16/2021-04:50:55] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,16777216) -> Float(1,256,65536,4194304) ***************
[08/16/2021-04:50:55] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,16777216) -> Half(1,256,65536,4194304) ***************
[08/16/2021-04:50:55] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,8388608) -> Half(1,256,65536:2,2097152) ***************
[08/16/2021-04:50:55] [V] [TRT] *************** Autotuning format combination: Half(32,8192,1:8,2097152) -> Float(1,256,65536,4194304) ***************
[08/16/2021-04:50:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:55] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:55] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:55] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:55] [V] [TRT] *************** Autotuning format combination: Half(32,8192,1:8,2097152) -> Half(8,2048,1:8,524288) ***************
[08/16/2021-04:50:55] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,4194304) -> Float(1,256,65536,4194304) ***************
[08/16/2021-04:50:55] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,4194304) -> Half(1,256,65536,4194304) ***************
[08/16/2021-04:50:55] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,2097152) -> Half(1,256,65536:2,2097152) ***************
[08/16/2021-04:50:55] [V] [TRT] *************** Autotuning format combination: Half(8,2048,1:8,524288) -> Float(1,256,65536,4194304) ***************
[08/16/2021-04:50:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:55] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:55] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:55] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:55] [V] [TRT] *************** Autotuning format combination: Half(8,2048,1:8,524288) -> Half(8,2048,1:8,524288) ***************
[08/16/2021-04:50:56] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,4194304), Float(1,256,65536,16777216) -> Float(1,256,65536,16777216) ***************
[08/16/2021-04:50:56] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,4194304), Half(1,256,65536,16777216) -> Half(1,256,65536,16777216) ***************
[08/16/2021-04:50:56] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,2097152), Half(1,256,65536:2,8388608) -> Half(1,256,65536:2,8388608) ***************
[08/16/2021-04:50:56] [V] [TRT] *************** Autotuning format combination: Half(8,2048,1:8,524288), Float(1,256,65536,16777216) -> Float(1,256,65536,16777216) ***************
[08/16/2021-04:50:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_out/Relu6 (CaskConvolution)
[08/16/2021-04:50:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_out/Relu6 (CudaConvolution)
[08/16/2021-04:50:56] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:56] [V] [TRT] *************** Autotuning format combination: Half(8,2048,1:8,524288), Half(32,8192,1:8,2097152) -> Half(32,8192,1:8,2097152) ***************
[08/16/2021-04:50:56] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,16777216) -> Float(1,128,16384,2097152) ***************
[08/16/2021-04:50:56] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:50:56] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:56] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:50:56] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:56] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:50:56] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:56] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:56] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:56] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:50:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:56] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:56] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:50:56] [V] [TRT] Tactic: 1754569683116234317 time 1.50432
[08/16/2021-04:50:56] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:56] [V] [TRT] Tactic: 1825138533642645384 time 1.5098
[08/16/2021-04:50:56] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:50:56] [V] [TRT] Tactic: 2733356012094739613 time 2.96788
[08/16/2021-04:50:56] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:56] [V] [TRT] Tactic: 3915320020053085238 time 1.49122
[08/16/2021-04:50:56] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:50:56] [V] [TRT] Tactic: 6808617066150061604 time 1.69116
[08/16/2021-04:50:56] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:56] [V] [TRT] Tactic: 9091006216302412844 time 1.67794
[08/16/2021-04:50:56] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:56] [V] [TRT] Tactic: -8060443123034038864 time 1.68462
[08/16/2021-04:50:56] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: -4420849921117327522 time 3.14099
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: -3946921629105938337 time 2.97286
[08/16/2021-04:50:57] [V] [TRT] Fastest Tactic: 3915320020053085238 Time: 1.49122
[08/16/2021-04:50:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:57] [V] [TRT] Tactic: 0 time 2.65224
[08/16/2021-04:50:57] [V] [TRT] Tactic: 2 time 3.62418
[08/16/2021-04:50:57] [V] [TRT] Tactic: 57 time 2.42247
[08/16/2021-04:50:57] [V] [TRT] Fastest Tactic: 57 Time: 2.42247
[08/16/2021-04:50:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3915320020053085238
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:57] [V] [TRT] 
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:57] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,16777216) -> Half(1,128,16384,2097152) ***************
[08/16/2021-04:50:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:57] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:57] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:57] [V] [TRT] Tactic: 0 time 2.56486
[08/16/2021-04:50:57] [V] [TRT] Tactic: 1 time 1.88934
[08/16/2021-04:50:57] [V] [TRT] Tactic: 2 time 2.75382
[08/16/2021-04:50:57] [V] [TRT] Fastest Tactic: 1 Time: 1.88934
[08/16/2021-04:50:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:50:57] [V] [TRT] 
[08/16/2021-04:50:57] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,8388608) -> Half(1,128,16384:2,1048576) ***************
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:50:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:57] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: 2418518597804310654 time 0.900284
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: 8292881859266835088 time 1.61587
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: 8401509141903434922 time 0.896972
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: -8654297089785671176 time 0.877388
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: -7140760933967189247 time 0.903316
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: -4097850214384059472 time 1.54351
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: -3689982367035295496 time 0.85856
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: -2534402059426524406 time 0.734152
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: -2027588946874785071 time 1.542
[08/16/2021-04:50:57] [V] [TRT] Fastest Tactic: -2534402059426524406 Time: 0.734152
[08/16/2021-04:50:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:57] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2534402059426524406
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:57] [V] [TRT] 
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:50:57] [V] [TRT] *************** Autotuning format combination: Half(32,8192,1:8,2097152) -> Float(1,128,16384,2097152) ***************
[08/16/2021-04:50:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:57] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:57] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:57] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:57] [V] [TRT] *************** Autotuning format combination: Half(32,8192,1:8,2097152) -> Half(16,2048,1:8,262144) ***************
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:57] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: 2105695814191699972 time 0.428388
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: 3754069740140581927 time 0.383884
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: 5666160310350604399 time 0.39516
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: 5925270497649423688 time 0.4108
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: 6680916730816870145 time 0.438216
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: 7158029511300006471 time 0.411292
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: 7859952145590271433 time 0.436836
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: 8283847742354150423 time 0.383716
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: -8391760416076885205 time 0.403772
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: -4534876761957424274 time 0.409452
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: -3237051169894153788 time 0.417288
[08/16/2021-04:50:57] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:57] [V] [TRT] Tactic: -2422160065350346448 time 0.430748
[08/16/2021-04:50:57] [V] [TRT] Fastest Tactic: 8283847742354150423 Time: 0.383716
[08/16/2021-04:50:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:57] [V] [TRT] Tactic: 0 time 2.62304
[08/16/2021-04:50:57] [V] [TRT] Tactic: 1 time 3.00974
[08/16/2021-04:50:58] [V] [TRT] Tactic: 2 time 6.70938
[08/16/2021-04:50:58] [V] [TRT] Fastest Tactic: 0 Time: 2.62304
[08/16/2021-04:50:58] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:58] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8283847742354150423
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:58] [V] [TRT] 
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:50:58] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:58] [V] [TRT] Tactic: 1002 time 0.457004
[08/16/2021-04:50:58] [V] [TRT] Tactic: 0 time 0.434028
[08/16/2021-04:50:58] [V] [TRT] Fastest Tactic: 0 Time: 0.434028
[08/16/2021-04:50:58] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:58] [V] [TRT] Tactic: 1002 time 0.906968
[08/16/2021-04:50:58] [V] [TRT] Tactic: 0 time 0.277948
[08/16/2021-04:50:58] [V] [TRT] Fastest Tactic: 0 Time: 0.277948
[08/16/2021-04:50:58] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:58] [V] [TRT] Tactic: 1002 time 0.55626
[08/16/2021-04:50:58] [V] [TRT] Tactic: 0 time 0.275324
[08/16/2021-04:50:58] [V] [TRT] Fastest Tactic: 0 Time: 0.275324
[08/16/2021-04:50:58] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:58] [V] [TRT] Tactic: 1002 time 0.515772
[08/16/2021-04:50:58] [V] [TRT] Tactic: 0 time 0.422096
[08/16/2021-04:50:58] [V] [TRT] Fastest Tactic: 0 Time: 0.422096
[08/16/2021-04:50:58] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:58] [V] [TRT] Tactic: 1002 time 0.903796
[08/16/2021-04:50:58] [V] [TRT] Tactic: 0 time 0.222376
[08/16/2021-04:50:58] [V] [TRT] Fastest Tactic: 0 Time: 0.222376
[08/16/2021-04:50:58] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:58] [V] [TRT] Tactic: 1002 time 0.558328
[08/16/2021-04:50:58] [V] [TRT] Tactic: 0 time 0.208336
[08/16/2021-04:50:58] [V] [TRT] Fastest Tactic: 0 Time: 0.208336
[08/16/2021-04:50:58] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:58] [V] [TRT] Tactic: 1002 time 0.97556
[08/16/2021-04:50:58] [V] [TRT] Tactic: 0 time 0.278508
[08/16/2021-04:50:58] [V] [TRT] Fastest Tactic: 0 Time: 0.278508
[08/16/2021-04:50:58] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:58] [V] [TRT] Tactic: 1002 time 0.9812
[08/16/2021-04:50:58] [V] [TRT] Tactic: 0 time 0.21332
[08/16/2021-04:50:58] [V] [TRT] Fastest Tactic: 0 Time: 0.21332
[08/16/2021-04:50:58] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:58] [V] [TRT] Tactic: 1002 time 0.55482
[08/16/2021-04:50:58] [V] [TRT] Tactic: 0 time 0.213592
[08/16/2021-04:50:58] [V] [TRT] Fastest Tactic: 0 Time: 0.213592
[08/16/2021-04:50:58] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:58] [V] [TRT] Tactic: 1002 time 0.567364
[08/16/2021-04:50:58] [V] [TRT] Tactic: 0 time 0.280156
[08/16/2021-04:50:58] [V] [TRT] Fastest Tactic: 0 Time: 0.280156
[08/16/2021-04:50:58] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:58] [V] [TRT] Tactic: 1002 time 0.556776
[08/16/2021-04:50:58] [V] [TRT] Tactic: 0 time 0.182964
[08/16/2021-04:50:58] [V] [TRT] Fastest Tactic: 0 Time: 0.182964
[08/16/2021-04:50:58] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:50:58] [V] [TRT] Tactic: 1002 time 0.885492
[08/16/2021-04:50:58] [V] [TRT] Tactic: 0 time 0.182308
[08/16/2021-04:50:58] [V] [TRT] Fastest Tactic: 0 Time: 0.182308
[08/16/2021-04:50:58] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,2097152) -> Float(1,128,16384,2097152) ***************
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:50:58] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:58] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:58] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:50:58] [V] [TRT] Tactic: 1825138533642645384 time 5.98725
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:50:58] [V] [TRT] Tactic: 2842488832350522458 time 5.98318
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:50:58] [V] [TRT] Tactic: 3915320020053085238 time 5.9577
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:50:58] [V] [TRT] Tactic: 6448355332020552203 time 6.20943
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:50:58] [V] [TRT] Tactic: 6808617066150061604 time 6.00012
[08/16/2021-04:50:58] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:50:59] [V] [TRT] Tactic: -8060443123034038864 time 6.20116
[08/16/2021-04:50:59] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:50:59] [V] [TRT] Tactic: -4420849921117327522 time 6.6213
[08/16/2021-04:50:59] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:50:59] [V] [TRT] Tactic: -3946921629105938337 time 6.39586
[08/16/2021-04:50:59] [V] [TRT] Fastest Tactic: 3915320020053085238 Time: 5.9577
[08/16/2021-04:50:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:59] [V] [TRT] Tactic: 0 time 8.25964
[08/16/2021-04:50:59] [V] [TRT] Tactic: 2 skipped. Scratch requested: 75497472, available: 16777216
[08/16/2021-04:50:59] [V] [TRT] Tactic: 5 skipped. Scratch requested: 73531392, available: 16777216
[08/16/2021-04:50:59] [V] [TRT] Tactic: 6 time 4.18131
[08/16/2021-04:50:59] [V] [TRT] Tactic: 57 time 7.36704
[08/16/2021-04:50:59] [V] [TRT] Fastest Tactic: 6 Time: 4.18131
[08/16/2021-04:50:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6
[08/16/2021-04:50:59] [V] [TRT] 
[08/16/2021-04:50:59] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,2097152) -> Half(1,128,16384,2097152) ***************
[08/16/2021-04:50:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:50:59] [V] [TRT] Tactic: 0 time 8.25178
[08/16/2021-04:50:59] [V] [TRT] Tactic: 1 time 7.13062
[08/16/2021-04:50:59] [V] [TRT] Tactic: 2 skipped. Scratch requested: 37748736, available: 16777216
[08/16/2021-04:50:59] [V] [TRT] Tactic: 4 skipped. Scratch requested: 8725266432, available: 16777216
[08/16/2021-04:50:59] [V] [TRT] Tactic: 5 skipped. Scratch requested: 73531392, available: 16777216
[08/16/2021-04:50:59] [V] [TRT] Tactic: 6 skipped. Scratch requested: 19006464, available: 16777216
[08/16/2021-04:50:59] [V] [TRT] Fastest Tactic: 1 Time: 7.13062
[08/16/2021-04:50:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:50:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:50:59] [V] [TRT] 
[08/16/2021-04:50:59] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,1048576) -> Half(1,128,16384:2,1048576) ***************
[08/16/2021-04:50:59] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:50:59] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:50:59] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:50:59] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:50:59] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:50:59] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:50:59] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:50:59] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:50:59] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:50:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:50:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:50:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:50:59] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:51:00] [V] [TRT] Tactic: 1145226902788474763 time 3.07358
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:00] [V] [TRT] Tactic: 2418518597804310654 time 3.1814
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:00] [V] [TRT] Tactic: 8292881859266835088 time 3.34596
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:00] [V] [TRT] Tactic: 8401509141903434922 time 3.04446
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:00] [V] [TRT] Tactic: -8654297089785671176 time 3.16751
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:51:00] [V] [TRT] Tactic: -7448936905981214224 time 3.37967
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:00] [V] [TRT] Tactic: -3689982367035295496 time 3.17985
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:00] [V] [TRT] Tactic: -2027588946874785071 time 3.20999
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:51:00] [V] [TRT] Tactic: -245090590808296743 time 3.22486
[08/16/2021-04:51:00] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 3.04446
[08/16/2021-04:51:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:00] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:00] [V] [TRT] 
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:00] [V] [TRT] *************** Autotuning format combination: Half(16,2048,1:8,262144) -> Float(1,128,16384,2097152) ***************
[08/16/2021-04:51:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:00] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:00] [V] [TRT] *************** Autotuning format combination: Half(16,2048,1:8,262144) -> Half(16,2048,1:8,262144) ***************
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:00] [V] [TRT] Tactic: 3754069740140581927 time 1.02846
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:00] [V] [TRT] Tactic: 5925270497649423688 time 0.997896
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:00] [V] [TRT] Tactic: 6680916730816870145 time 1.1321
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:00] [V] [TRT] Tactic: 7158029511300006471 time 1.05509
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:00] [V] [TRT] Tactic: 7859952145590271433 time 1.13258
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:00] [V] [TRT] Tactic: 8283847742354150423 time 1.01738
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:00] [V] [TRT] Tactic: -4534876761957424274 time 1.02621
[08/16/2021-04:51:00] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:00] [V] [TRT] Tactic: -3237051169894153788 time 1.03476
[08/16/2021-04:51:00] [V] [TRT] Fastest Tactic: 5925270497649423688 Time: 0.997896
[08/16/2021-04:51:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:00] [V] [TRT] Tactic: 0 time 9.28959
[08/16/2021-04:51:01] [V] [TRT] Tactic: 1 time 7.5135
[08/16/2021-04:51:01] [V] [TRT] Tactic: 2 skipped. Scratch requested: 41943552, available: 16777216
[08/16/2021-04:51:01] [V] [TRT] Tactic: 6 skipped. Scratch requested: 19006464, available: 16777216
[08/16/2021-04:51:01] [V] [TRT] Fastest Tactic: 1 Time: 7.5135
[08/16/2021-04:51:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5925270497649423688
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:01] [V] [TRT] 
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:01] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,2097152) -> Float(1,128,16384,8388608) ***************
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (FusedConvActConvolution)
[08/16/2021-04:51:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (CaskConvolution)
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:01] [V] [TRT] Tactic: 1754569683116234317 time 3.03707
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:01] [V] [TRT] Tactic: 1825138533642645384 time 3.05304
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:01] [V] [TRT] Tactic: 2733356012094739613 time 3.75245
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:01] [V] [TRT] Tactic: 3915320020053085238 time 3.05437
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:01] [V] [TRT] Tactic: 6808617066150061604 time 2.85598
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:01] [V] [TRT] Tactic: 9091006216302412844 time 2.77615
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:01] [V] [TRT] Tactic: -8060443123034038864 time 2.89971
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:01] [V] [TRT] Tactic: -4420849921117327522 time 4.47014
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:01] [V] [TRT] Tactic: -3946921629105938337 time 3.73626
[08/16/2021-04:51:01] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 2.77615
[08/16/2021-04:51:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (CudaConvolution)
[08/16/2021-04:51:01] [V] [TRT] Tactic: 0 time 5.72647
[08/16/2021-04:51:01] [V] [TRT] Tactic: 2 time 5.91658
[08/16/2021-04:51:01] [V] [TRT] Tactic: 5 skipped. Scratch requested: 31195136, available: 16777216
[08/16/2021-04:51:01] [V] [TRT] Tactic: 57 time 4.44085
[08/16/2021-04:51:01] [V] [TRT] Fastest Tactic: 57 Time: 4.44085
[08/16/2021-04:51:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[08/16/2021-04:51:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:01] [V] [TRT] 
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:01] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:01] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,2097152) -> Half(1,128,16384,8388608) ***************
[08/16/2021-04:51:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (FusedConvActConvolution)
[08/16/2021-04:51:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (CaskConvolution)
[08/16/2021-04:51:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (CudaConvolution)
[08/16/2021-04:51:01] [V] [TRT] Tactic: 0 time 4.86727
[08/16/2021-04:51:02] [V] [TRT] Tactic: 1 time 4.51964
[08/16/2021-04:51:02] [V] [TRT] Tactic: 2 time 5.15509
[08/16/2021-04:51:02] [V] [TRT] Tactic: 4 skipped. Scratch requested: 8741453824, available: 16777216
[08/16/2021-04:51:02] [V] [TRT] Tactic: 5 skipped. Scratch requested: 31195136, available: 16777216
[08/16/2021-04:51:02] [V] [TRT] Fastest Tactic: 1 Time: 4.51964
[08/16/2021-04:51:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[08/16/2021-04:51:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:51:02] [V] [TRT] 
[08/16/2021-04:51:02] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,1048576) -> Half(1,128,16384:2,4194304) ***************
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (FusedConvActConvolution)
[08/16/2021-04:51:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (CaskConvolution)
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: 2418518597804310654 time 1.54686
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: 8292881859266835088 time 2.02172
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: 8401509141903434922 time 1.52315
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: -8654297089785671176 time 1.94946
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: -7140760933967189247 time 1.51053
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: -4097850214384059472 time 1.84538
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: -3689982367035295496 time 1.95354
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: -2534402059426524406 time 1.55921
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: -2027588946874785071 time 1.97068
[08/16/2021-04:51:02] [V] [TRT] Fastest Tactic: -7140760933967189247 Time: 1.51053
[08/16/2021-04:51:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (CudaConvolution)
[08/16/2021-04:51:02] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[08/16/2021-04:51:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7140760933967189247
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:02] [V] [TRT] 
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:02] [V] [TRT] *************** Autotuning format combination: Half(16,2048,1:8,262144) -> Float(1,128,16384,8388608) ***************
[08/16/2021-04:51:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (FusedConvActConvolution)
[08/16/2021-04:51:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (CaskConvolution)
[08/16/2021-04:51:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (CudaConvolution)
[08/16/2021-04:51:02] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[08/16/2021-04:51:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:02] [V] [TRT] *************** Autotuning format combination: Half(16,2048,1:8,262144) -> Half(64,8192,1:8,1048576) ***************
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (FusedConvActConvolution)
[08/16/2021-04:51:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (CaskConvolution)
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: 2105695814191699972 time 1.08836
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: 3754069740140581927 time 0.907996
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: 5666160310350604399 time 0.897368
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: 5925270497649423688 time 0.962744
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: 6680916730816870145 time 1.05776
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: 7158029511300006471 time 0.962932
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: 7859952145590271433 time 1.04142
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: 8283847742354150423 time 0.913552
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: -8391760416076885205 time 0.959428
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: -4534876761957424274 time 0.97086
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: -3237051169894153788 time 0.957336
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] Tactic: -2422160065350346448 time 1.03273
[08/16/2021-04:51:02] [V] [TRT] Fastest Tactic: 5666160310350604399 Time: 0.897368
[08/16/2021-04:51:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (CudaConvolution)
[08/16/2021-04:51:02] [V] [TRT] Tactic: 0 time 5.58609
[08/16/2021-04:51:02] [V] [TRT] Tactic: 1 skipped. Scratch requested: 21201408, available: 16777216
[08/16/2021-04:51:02] [V] [TRT] Tactic: 2 skipped. Scratch requested: 20972032, available: 16777216
[08/16/2021-04:51:02] [V] [TRT] Fastest Tactic: 0 Time: 5.58609
[08/16/2021-04:51:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[08/16/2021-04:51:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5666160310350604399
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] 
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:02] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:03] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:03] [V] [TRT] Tactic: 1002 time 1.87409
[08/16/2021-04:51:03] [V] [TRT] Tactic: 0 time 1.7047
[08/16/2021-04:51:03] [V] [TRT] Fastest Tactic: 0 Time: 1.7047
[08/16/2021-04:51:03] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:03] [V] [TRT] Tactic: 1002 time 3.66286
[08/16/2021-04:51:03] [V] [TRT] Tactic: 0 time 1.08566
[08/16/2021-04:51:03] [V] [TRT] Fastest Tactic: 0 Time: 1.08566
[08/16/2021-04:51:03] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:03] [V] [TRT] Tactic: 1002 time 2.19886
[08/16/2021-04:51:03] [V] [TRT] Tactic: 0 time 1.1025
[08/16/2021-04:51:03] [V] [TRT] Fastest Tactic: 0 Time: 1.1025
[08/16/2021-04:51:03] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:03] [V] [TRT] Tactic: 1002 time 2.1016
[08/16/2021-04:51:03] [V] [TRT] Tactic: 0 time 1.66689
[08/16/2021-04:51:03] [V] [TRT] Fastest Tactic: 0 Time: 1.66689
[08/16/2021-04:51:03] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:03] [V] [TRT] Tactic: 1002 time 3.64087
[08/16/2021-04:51:03] [V] [TRT] Tactic: 0 time 0.875084
[08/16/2021-04:51:03] [V] [TRT] Fastest Tactic: 0 Time: 0.875084
[08/16/2021-04:51:03] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:03] [V] [TRT] Tactic: 1002 time 2.22233
[08/16/2021-04:51:03] [V] [TRT] Tactic: 0 time 0.799864
[08/16/2021-04:51:03] [V] [TRT] Fastest Tactic: 0 Time: 0.799864
[08/16/2021-04:51:03] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:03] [V] [TRT] Tactic: 1002 time 3.96549
[08/16/2021-04:51:03] [V] [TRT] Tactic: 0 time 1.09805
[08/16/2021-04:51:03] [V] [TRT] Fastest Tactic: 0 Time: 1.09805
[08/16/2021-04:51:03] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:03] [V] [TRT] Tactic: 1002 time 3.96292
[08/16/2021-04:51:03] [V] [TRT] Tactic: 0 time 0.841804
[08/16/2021-04:51:03] [V] [TRT] Fastest Tactic: 0 Time: 0.841804
[08/16/2021-04:51:03] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:03] [V] [TRT] Tactic: 1002 time 2.1882
[08/16/2021-04:51:03] [V] [TRT] Tactic: 0 time 0.811608
[08/16/2021-04:51:03] [V] [TRT] Fastest Tactic: 0 Time: 0.811608
[08/16/2021-04:51:03] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:03] [V] [TRT] Tactic: 1002 time 2.27342
[08/16/2021-04:51:03] [V] [TRT] Tactic: 0 time 1.11094
[08/16/2021-04:51:03] [V] [TRT] Fastest Tactic: 0 Time: 1.11094
[08/16/2021-04:51:03] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:03] [V] [TRT] Tactic: 1002 time 2.21285
[08/16/2021-04:51:03] [V] [TRT] Tactic: 0 time 0.73266
[08/16/2021-04:51:03] [V] [TRT] Fastest Tactic: 0 Time: 0.73266
[08/16/2021-04:51:03] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:04] [V] [TRT] Tactic: 1002 time 3.50057
[08/16/2021-04:51:04] [V] [TRT] Tactic: 0 time 0.75232
[08/16/2021-04:51:04] [V] [TRT] Fastest Tactic: 0 Time: 0.75232
[08/16/2021-04:51:04] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,16777216), Float(1,128,16384,8388608) -> Float(1,128,16384,8388608) ***************
[08/16/2021-04:51:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:04] [V] [TRT] Tactic: 1754569683116234317 time 6.01904
[08/16/2021-04:51:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:04] [V] [TRT] Tactic: 1825138533642645384 time 6.03226
[08/16/2021-04:51:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:04] [V] [TRT] Tactic: 2733356012094739613 time 12.569
[08/16/2021-04:51:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:04] [V] [TRT] Tactic: 3915320020053085238 time 6.06568
[08/16/2021-04:51:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:04] [V] [TRT] Tactic: 6808617066150061604 time 7.28795
[08/16/2021-04:51:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:04] [V] [TRT] Tactic: 9091006216302412844 time 7.26302
[08/16/2021-04:51:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:04] [V] [TRT] Tactic: -8060443123034038864 time 7.28247
[08/16/2021-04:51:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:05] [V] [TRT] Tactic: -4420849921117327522 time 12.7191
[08/16/2021-04:51:05] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:05] [V] [TRT] Tactic: -3946921629105938337 time 12.5878
[08/16/2021-04:51:05] [V] [TRT] Fastest Tactic: 1754569683116234317 Time: 6.01904
[08/16/2021-04:51:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:05] [V] [TRT] Tactic: 0 time 12.2505
[08/16/2021-04:51:05] [V] [TRT] Tactic: 2 time 13.0876
[08/16/2021-04:51:06] [V] [TRT] Tactic: 57 time 11.6423
[08/16/2021-04:51:06] [V] [TRT] Fastest Tactic: 57 Time: 11.6423
[08/16/2021-04:51:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1754569683116234317
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:06] [V] [TRT] 
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:06] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536,16777216), Half(1,128,16384,8388608) -> Half(1,128,16384,8388608) ***************
[08/16/2021-04:51:06] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:06] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:06] [V] [TRT] Tactic: 0 time 10.3416
[08/16/2021-04:51:06] [V] [TRT] Tactic: 1 time 8.75812
[08/16/2021-04:51:06] [V] [TRT] Tactic: 2 time 9.75866
[08/16/2021-04:51:06] [V] [TRT] Fastest Tactic: 1 Time: 8.75812
[08/16/2021-04:51:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:51:06] [V] [TRT] 
[08/16/2021-04:51:06] [V] [TRT] *************** Autotuning format combination: Half(1,256,65536:2,8388608), Half(1,128,16384:2,4194304) -> Half(1,128,16384:2,4194304) ***************
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:06] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:06] [V] [TRT] Tactic: 2418518597804310654 time 3.63359
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:06] [V] [TRT] Tactic: 8292881859266835088 time 6.35028
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:06] [V] [TRT] Tactic: 8401509141903434922 time 3.62992
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:06] [V] [TRT] Tactic: -8654297089785671176 time 3.4756
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:06] [V] [TRT] Tactic: -7140760933967189247 time 3.68184
[08/16/2021-04:51:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:07] [V] [TRT] Tactic: -4097850214384059472 time 6.375
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:07] [V] [TRT] Tactic: -3689982367035295496 time 3.47858
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:07] [V] [TRT] Tactic: -2534402059426524406 time 2.98912
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:07] [V] [TRT] Tactic: -2027588946874785071 time 6.34933
[08/16/2021-04:51:07] [V] [TRT] Fastest Tactic: -2534402059426524406 Time: 2.98912
[08/16/2021-04:51:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:07] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2534402059426524406
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:07] [V] [TRT] 
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:07] [V] [TRT] *************** Autotuning format combination: Half(32,8192,1:8,2097152), Float(1,128,16384,8388608) -> Float(1,128,16384,8388608) ***************
[08/16/2021-04:51:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:07] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:07] [V] [TRT] *************** Autotuning format combination: Half(32,8192,1:8,2097152), Half(64,8192,1:8,1048576) -> Half(64,8192,1:8,1048576) ***************
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] Tactic: 2105695814191699972 time 1.74856
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] Tactic: 3754069740140581927 time 1.54608
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] Tactic: 5666160310350604399 time 1.54584
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] Tactic: 5925270497649423688 time 1.56596
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] Tactic: 6680916730816870145 time 2.08002
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] Tactic: 7158029511300006471 time 1.67292
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] Tactic: 7859952145590271433 time 2.06325
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] Tactic: 8283847742354150423 time 1.54493
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] Tactic: -8391760416076885205 time 1.57671
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] Tactic: -4534876761957424274 time 1.57177
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] Tactic: -3237051169894153788 time 1.67212
[08/16/2021-04:51:07] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:07] [V] [TRT] Tactic: -2422160065350346448 time 2.02654
[08/16/2021-04:51:07] [V] [TRT] Fastest Tactic: 8283847742354150423 Time: 1.54493
[08/16/2021-04:51:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:07] [V] [TRT] Tactic: 0 time 10.6983
[08/16/2021-04:51:08] [V] [TRT] Tactic: 1 time 11.1893
[08/16/2021-04:51:08] [V] [TRT] Tactic: 2 skipped. Scratch requested: 25166336, available: 16777216
[08/16/2021-04:51:08] [V] [TRT] Fastest Tactic: 0 Time: 10.6983
[08/16/2021-04:51:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8283847742354150423
[08/16/2021-04:51:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:08] [V] [TRT] 
[08/16/2021-04:51:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:08] [V] [TRT] Tactic: 1002 time 1.76415
[08/16/2021-04:51:08] [V] [TRT] Tactic: 0 time 1.70322
[08/16/2021-04:51:08] [V] [TRT] Fastest Tactic: 0 Time: 1.70322
[08/16/2021-04:51:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:08] [V] [TRT] Tactic: 1002 time 3.6569
[08/16/2021-04:51:08] [V] [TRT] Tactic: 0 time 1.08419
[08/16/2021-04:51:08] [V] [TRT] Fastest Tactic: 0 Time: 1.08419
[08/16/2021-04:51:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:08] [V] [TRT] Tactic: 1002 time 2.19595
[08/16/2021-04:51:08] [V] [TRT] Tactic: 0 time 1.09487
[08/16/2021-04:51:08] [V] [TRT] Fastest Tactic: 0 Time: 1.09487
[08/16/2021-04:51:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:08] [V] [TRT] Tactic: 1002 time 2.11322
[08/16/2021-04:51:08] [V] [TRT] Tactic: 0 time 1.6668
[08/16/2021-04:51:08] [V] [TRT] Fastest Tactic: 0 Time: 1.6668
[08/16/2021-04:51:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:08] [V] [TRT] Tactic: 1002 time 3.63752
[08/16/2021-04:51:08] [V] [TRT] Tactic: 0 time 0.869916
[08/16/2021-04:51:08] [V] [TRT] Fastest Tactic: 0 Time: 0.869916
[08/16/2021-04:51:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:08] [V] [TRT] Tactic: 1002 time 2.23131
[08/16/2021-04:51:08] [V] [TRT] Tactic: 0 time 0.796748
[08/16/2021-04:51:08] [V] [TRT] Fastest Tactic: 0 Time: 0.796748
[08/16/2021-04:51:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:08] [V] [TRT] Tactic: 1002 time 4.00087
[08/16/2021-04:51:08] [V] [TRT] Tactic: 0 time 1.0947
[08/16/2021-04:51:08] [V] [TRT] Fastest Tactic: 0 Time: 1.0947
[08/16/2021-04:51:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:08] [V] [TRT] Tactic: 1002 time 3.96614
[08/16/2021-04:51:08] [V] [TRT] Tactic: 0 time 0.8363
[08/16/2021-04:51:08] [V] [TRT] Fastest Tactic: 0 Time: 0.8363
[08/16/2021-04:51:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:08] [V] [TRT] Tactic: 1002 time 2.18966
[08/16/2021-04:51:08] [V] [TRT] Tactic: 0 time 0.806772
[08/16/2021-04:51:08] [V] [TRT] Fastest Tactic: 0 Time: 0.806772
[08/16/2021-04:51:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:08] [V] [TRT] Tactic: 1002 time 2.27425
[08/16/2021-04:51:08] [V] [TRT] Tactic: 0 time 1.1055
[08/16/2021-04:51:08] [V] [TRT] Fastest Tactic: 0 Time: 1.1055
[08/16/2021-04:51:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:08] [V] [TRT] Tactic: 1002 time 2.21206
[08/16/2021-04:51:08] [V] [TRT] Tactic: 0 time 0.724816
[08/16/2021-04:51:08] [V] [TRT] Fastest Tactic: 0 Time: 0.724816
[08/16/2021-04:51:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:09] [V] [TRT] Tactic: 1002 time 3.50359
[08/16/2021-04:51:09] [V] [TRT] Tactic: 0 time 0.73388
[08/16/2021-04:51:09] [V] [TRT] Fastest Tactic: 0 Time: 0.73388
[08/16/2021-04:51:09] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,8388608) -> Float(1,128,16384,2097152) ***************
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:09] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:09] [V] [TRT] Tactic: 1754569683116234317 time 2.8059
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:09] [V] [TRT] Tactic: 1825138533642645384 time 2.81677
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:09] [V] [TRT] Tactic: 2733356012094739613 time 3.28449
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:09] [V] [TRT] Tactic: 3915320020053085238 time 2.80238
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:09] [V] [TRT] Tactic: 6808617066150061604 time 2.82131
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:09] [V] [TRT] Tactic: 9091006216302412844 time 2.74594
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:09] [V] [TRT] Tactic: -8060443123034038864 time 2.84222
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:09] [V] [TRT] Tactic: -4420849921117327522 time 3.8394
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:09] [V] [TRT] Tactic: -3946921629105938337 time 3.28574
[08/16/2021-04:51:09] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 2.74594
[08/16/2021-04:51:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:09] [V] [TRT] Tactic: 0 time 4.20344
[08/16/2021-04:51:09] [V] [TRT] Tactic: 2 skipped. Scratch requested: 33554432, available: 16777216
[08/16/2021-04:51:09] [V] [TRT] Tactic: 5 skipped. Scratch requested: 31195136, available: 16777216
[08/16/2021-04:51:09] [V] [TRT] Tactic: 57 time 4.07712
[08/16/2021-04:51:09] [V] [TRT] Fastest Tactic: 57 Time: 4.07712
[08/16/2021-04:51:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:09] [V] [TRT] 
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:09] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:09] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,8388608) -> Half(1,128,16384,2097152) ***************
[08/16/2021-04:51:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:09] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:09] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:09] [V] [TRT] Tactic: 0 time 4.29101
[08/16/2021-04:51:09] [V] [TRT] Tactic: 1 time 3.75795
[08/16/2021-04:51:10] [V] [TRT] Tactic: 2 time 4.65164
[08/16/2021-04:51:10] [V] [TRT] Tactic: 4 skipped. Scratch requested: 8792571904, available: 16777216
[08/16/2021-04:51:10] [V] [TRT] Tactic: 5 skipped. Scratch requested: 31195136, available: 16777216
[08/16/2021-04:51:10] [V] [TRT] Fastest Tactic: 1 Time: 3.75795
[08/16/2021-04:51:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:51:10] [V] [TRT] 
[08/16/2021-04:51:10] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,4194304) -> Half(1,128,16384:2,1048576) ***************
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:10] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: 2418518597804310654 time 1.4125
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: 8292881859266835088 time 1.69681
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: 8401509141903434922 time 1.39136
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: -8654297089785671176 time 1.5117
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: -7140760933967189247 time 1.37772
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: -4097850214384059472 time 1.58074
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: -3689982367035295496 time 1.51516
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: -2534402059426524406 time 1.43083
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: -2027588946874785071 time 1.65345
[08/16/2021-04:51:10] [V] [TRT] Fastest Tactic: -7140760933967189247 Time: 1.37772
[08/16/2021-04:51:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:10] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7140760933967189247
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:10] [V] [TRT] 
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:10] [V] [TRT] *************** Autotuning format combination: Half(64,8192,1:8,1048576) -> Float(1,128,16384,2097152) ***************
[08/16/2021-04:51:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:10] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:10] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:10] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:10] [V] [TRT] *************** Autotuning format combination: Half(64,8192,1:8,1048576) -> Half(16,2048,1:8,262144) ***************
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:10] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: 2105695814191699972 time 0.6564
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: 3754069740140581927 time 0.590496
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: 5666160310350604399 time 0.591144
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: 5925270497649423688 time 0.607812
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: 6680916730816870145 time 0.727052
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: 7158029511300006471 time 0.65304
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: 7859952145590271433 time 0.722404
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: 8283847742354150423 time 0.590044
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: -8391760416076885205 time 0.63022
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: -4534876761957424274 time 0.62358
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: -3237051169894153788 time 0.6523
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: -2422160065350346448 time 0.708572
[08/16/2021-04:51:10] [V] [TRT] Fastest Tactic: 8283847742354150423 Time: 0.590044
[08/16/2021-04:51:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:10] [V] [TRT] Tactic: 0 time 4.55037
[08/16/2021-04:51:10] [V] [TRT] Tactic: 1 skipped. Scratch requested: 21201408, available: 16777216
[08/16/2021-04:51:10] [V] [TRT] Tactic: 2 skipped. Scratch requested: 20972032, available: 16777216
[08/16/2021-04:51:10] [V] [TRT] Fastest Tactic: 0 Time: 4.55037
[08/16/2021-04:51:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8283847742354150423
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] 
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:10] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,2097152) -> Float(1,128,16384,2097152) ***************
[08/16/2021-04:51:10] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,2097152) -> Half(1,128,16384,2097152) ***************
[08/16/2021-04:51:10] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,1048576) -> Half(1,128,16384:2,1048576) ***************
[08/16/2021-04:51:10] [V] [TRT] *************** Autotuning format combination: Half(16,2048,1:8,262144) -> Float(1,128,16384,2097152) ***************
[08/16/2021-04:51:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:10] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:10] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:10] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:10] [V] [TRT] *************** Autotuning format combination: Half(16,2048,1:8,262144) -> Half(16,2048,1:8,262144) ***************
[08/16/2021-04:51:10] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,2097152), Float(1,128,16384,8388608) -> Float(1,128,16384,8388608) ***************
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:10] [V] [TRT] Tactic: 1754569683116234317 time 3.42383
[08/16/2021-04:51:10] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:11] [V] [TRT] Tactic: 1825138533642645384 time 3.37854
[08/16/2021-04:51:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:11] [V] [TRT] Tactic: 2733356012094739613 time 4.49641
[08/16/2021-04:51:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:11] [V] [TRT] Tactic: 3915320020053085238 time 3.40447
[08/16/2021-04:51:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:11] [V] [TRT] Tactic: 6808617066150061604 time 3.17801
[08/16/2021-04:51:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:11] [V] [TRT] Tactic: 9091006216302412844 time 3.21168
[08/16/2021-04:51:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:11] [V] [TRT] Tactic: -8060443123034038864 time 3.20971
[08/16/2021-04:51:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:11] [V] [TRT] Tactic: -4420849921117327522 time 4.96078
[08/16/2021-04:51:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:11] [V] [TRT] Tactic: -3946921629105938337 time 4.43637
[08/16/2021-04:51:11] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 3.17801
[08/16/2021-04:51:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:11] [V] [TRT] Tactic: 0 time 9.30417
[08/16/2021-04:51:11] [V] [TRT] Tactic: 2 time 9.4848
[08/16/2021-04:51:11] [V] [TRT] Tactic: 5 skipped. Scratch requested: 31195136, available: 16777216
[08/16/2021-04:51:11] [V] [TRT] Tactic: 57 time 8.04506
[08/16/2021-04:51:11] [V] [TRT] Fastest Tactic: 57 Time: 8.04506
[08/16/2021-04:51:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6808617066150061604
[08/16/2021-04:51:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:11] [V] [TRT] 
[08/16/2021-04:51:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:11] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,2097152), Half(1,128,16384,8388608) -> Half(1,128,16384,8388608) ***************
[08/16/2021-04:51:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:12] [V] [TRT] Tactic: 0 time 6.9368
[08/16/2021-04:51:12] [V] [TRT] Tactic: 1 time 6.52905
[08/16/2021-04:51:12] [V] [TRT] Tactic: 2 time 7.16029
[08/16/2021-04:51:12] [V] [TRT] Tactic: 4 skipped. Scratch requested: 8741453824, available: 16777216
[08/16/2021-04:51:12] [V] [TRT] Tactic: 5 skipped. Scratch requested: 31195136, available: 16777216
[08/16/2021-04:51:12] [V] [TRT] Fastest Tactic: 1 Time: 6.52905
[08/16/2021-04:51:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:51:12] [V] [TRT] 
[08/16/2021-04:51:12] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,1048576), Half(1,128,16384:2,4194304) -> Half(1,128,16384:2,4194304) ***************
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:12] [V] [TRT] Tactic: 2418518597804310654 time 1.70584
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:12] [V] [TRT] Tactic: 8292881859266835088 time 2.46643
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:12] [V] [TRT] Tactic: 8401509141903434922 time 1.70038
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:12] [V] [TRT] Tactic: -8654297089785671176 time 2.11226
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:12] [V] [TRT] Tactic: -7140760933967189247 time 1.71498
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:12] [V] [TRT] Tactic: -4097850214384059472 time 2.20585
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:12] [V] [TRT] Tactic: -3689982367035295496 time 2.10894
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:12] [V] [TRT] Tactic: -2534402059426524406 time 1.70348
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:12] [V] [TRT] Tactic: -2027588946874785071 time 2.3599
[08/16/2021-04:51:12] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 1.70038
[08/16/2021-04:51:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:12] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:12] [V] [TRT] 
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:12] [V] [TRT] *************** Autotuning format combination: Half(16,2048,1:8,262144), Float(1,128,16384,8388608) -> Float(1,128,16384,8388608) ***************
[08/16/2021-04:51:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:12] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:12] [V] [TRT] *************** Autotuning format combination: Half(16,2048,1:8,262144), Half(64,8192,1:8,1048576) -> Half(64,8192,1:8,1048576) ***************
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] Tactic: 2105695814191699972 time 1.28032
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] Tactic: 3754069740140581927 time 1.19263
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] Tactic: 5666160310350604399 time 1.18108
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] Tactic: 5925270497649423688 time 1.22376
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] Tactic: 6680916730816870145 time 1.50269
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] Tactic: 7158029511300006471 time 1.26203
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] Tactic: 7859952145590271433 time 1.48428
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] Tactic: 8283847742354150423 time 1.21136
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:12] [V] [TRT] Tactic: -8391760416076885205 time 1.22118
[08/16/2021-04:51:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:13] [V] [TRT] Tactic: -4534876761957424274 time 1.22225
[08/16/2021-04:51:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:13] [V] [TRT] Tactic: -3237051169894153788 time 1.26072
[08/16/2021-04:51:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:13] [V] [TRT] Tactic: -2422160065350346448 time 1.60517
[08/16/2021-04:51:13] [V] [TRT] Fastest Tactic: 5666160310350604399 Time: 1.18108
[08/16/2021-04:51:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:13] [V] [TRT] Tactic: 0 time 7.58285
[08/16/2021-04:51:13] [V] [TRT] Tactic: 1 skipped. Scratch requested: 21201408, available: 16777216
[08/16/2021-04:51:13] [V] [TRT] Tactic: 2 skipped. Scratch requested: 20972032, available: 16777216
[08/16/2021-04:51:13] [V] [TRT] Fastest Tactic: 0 Time: 7.58285
[08/16/2021-04:51:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5666160310350604399
[08/16/2021-04:51:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:13] [V] [TRT] 
[08/16/2021-04:51:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,8388608) -> Float(1,128,16384,2097152) ***************
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,8388608) -> Half(1,128,16384,2097152) ***************
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,4194304) -> Half(1,128,16384:2,1048576) ***************
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Half(64,8192,1:8,1048576) -> Float(1,128,16384,2097152) ***************
[08/16/2021-04:51:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:13] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Half(64,8192,1:8,1048576) -> Half(16,2048,1:8,262144) ***************
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,2097152) -> Float(1,128,16384,2097152) ***************
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,2097152) -> Half(1,128,16384,2097152) ***************
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,1048576) -> Half(1,128,16384:2,1048576) ***************
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Half(16,2048,1:8,262144) -> Float(1,128,16384,2097152) ***************
[08/16/2021-04:51:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:13] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Half(16,2048,1:8,262144) -> Half(16,2048,1:8,262144) ***************
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,2097152), Float(1,128,16384,8388608) -> Float(1,128,16384,8388608) ***************
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,2097152), Half(1,128,16384,8388608) -> Half(1,128,16384,8388608) ***************
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,1048576), Half(1,128,16384:2,4194304) -> Half(1,128,16384:2,4194304) ***************
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Half(16,2048,1:8,262144), Float(1,128,16384,8388608) -> Float(1,128,16384,8388608) ***************
[08/16/2021-04:51:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:13] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Half(16,2048,1:8,262144), Half(64,8192,1:8,1048576) -> Half(64,8192,1:8,1048576) ***************
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,8388608) -> Float(1,128,16384,2097152) ***************
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,8388608) -> Half(1,128,16384,2097152) ***************
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,4194304) -> Half(1,128,16384:2,1048576) ***************
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Half(64,8192,1:8,1048576) -> Float(1,128,16384,2097152) ***************
[08/16/2021-04:51:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:13] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Half(64,8192,1:8,1048576) -> Half(16,2048,1:8,262144) ***************
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,2097152) -> Float(1,128,16384,2097152) ***************
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,2097152) -> Half(1,128,16384,2097152) ***************
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,1048576) -> Half(1,128,16384:2,1048576) ***************
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Half(16,2048,1:8,262144) -> Float(1,128,16384,2097152) ***************
[08/16/2021-04:51:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:13] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:13] [V] [TRT] *************** Autotuning format combination: Half(16,2048,1:8,262144) -> Half(16,2048,1:8,262144) ***************
[08/16/2021-04:51:14] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,2097152), Float(1,128,16384,8388608) -> Float(1,128,16384,8388608) ***************
[08/16/2021-04:51:14] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,2097152), Half(1,128,16384,8388608) -> Half(1,128,16384,8388608) ***************
[08/16/2021-04:51:14] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,1048576), Half(1,128,16384:2,4194304) -> Half(1,128,16384:2,4194304) ***************
[08/16/2021-04:51:14] [V] [TRT] *************** Autotuning format combination: Half(16,2048,1:8,262144), Float(1,128,16384,8388608) -> Float(1,128,16384,8388608) ***************
[08/16/2021-04:51:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:14] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:14] [V] [TRT] *************** Autotuning format combination: Half(16,2048,1:8,262144), Half(64,8192,1:8,1048576) -> Half(64,8192,1:8,1048576) ***************
[08/16/2021-04:51:14] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,8388608) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:14] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:14] [V] [TRT] Tactic: 1754569683116234317 time 1.45184
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:14] [V] [TRT] Tactic: 1825138533642645384 time 1.47348
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:14] [V] [TRT] Tactic: 2733356012094739613 time 2.39626
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:14] [V] [TRT] Tactic: 3915320020053085238 time 1.47958
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:14] [V] [TRT] Tactic: 6808617066150061604 time 1.57691
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:14] [V] [TRT] Tactic: 9091006216302412844 time 1.59811
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:14] [V] [TRT] Tactic: -8060443123034038864 time 1.57413
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:14] [V] [TRT] Tactic: -4420849921117327522 time 2.92815
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:14] [V] [TRT] Tactic: -3946921629105938337 time 2.69781
[08/16/2021-04:51:14] [V] [TRT] Fastest Tactic: 1754569683116234317 Time: 1.45184
[08/16/2021-04:51:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:14] [V] [TRT] Tactic: 0 time 3.37715
[08/16/2021-04:51:14] [V] [TRT] Tactic: 2 time 2.63758
[08/16/2021-04:51:14] [V] [TRT] Tactic: 57 time 1.86091
[08/16/2021-04:51:14] [V] [TRT] Fastest Tactic: 57 Time: 1.86091
[08/16/2021-04:51:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1754569683116234317
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:14] [V] [TRT] 
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:14] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:14] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,8388608) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:51:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:14] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:15] [V] [TRT] Tactic: 0 time 2.40751
[08/16/2021-04:51:15] [V] [TRT] Tactic: 1 time 2.1181
[08/16/2021-04:51:15] [V] [TRT] Tactic: 2 time 2.37262
[08/16/2021-04:51:15] [V] [TRT] Fastest Tactic: 1 Time: 2.1181
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:51:15] [V] [TRT] 
[08/16/2021-04:51:15] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,4194304) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: 2418518597804310654 time 0.85016
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: 8292881859266835088 time 1.45267
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: 8401509141903434922 time 0.83032
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: -8654297089785671176 time 0.765896
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: -7140760933967189247 time 0.832236
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: -4097850214384059472 time 1.37363
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: -3689982367035295496 time 0.765648
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: -2534402059426524406 time 0.758832
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: -2027588946874785071 time 1.4339
[08/16/2021-04:51:15] [V] [TRT] Fastest Tactic: -2534402059426524406 Time: 0.758832
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:15] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2534402059426524406
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:15] [V] [TRT] 
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:15] [V] [TRT] *************** Autotuning format combination: Half(64,8192,1:8,1048576) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:15] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:15] [V] [TRT] *************** Autotuning format combination: Half(64,8192,1:8,1048576) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: 2105695814191699972 time 0.32316
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: 3754069740140581927 time 0.295416
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: 5666160310350604399 time 0.293836
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: 5925270497649423688 time 0.30804
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: 6680916730816870145 time 0.352328
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: 7158029511300006471 time 0.321072
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: 7859952145590271433 time 0.346456
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: 8283847742354150423 time 0.295048
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: -8391760416076885205 time 0.309644
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: -4534876761957424274 time 0.322092
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: -3237051169894153788 time 0.320392
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] Tactic: -2422160065350346448 time 0.3422
[08/16/2021-04:51:15] [V] [TRT] Fastest Tactic: 5666160310350604399 Time: 0.293836
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:15] [V] [TRT] Tactic: 0 time 2.35752
[08/16/2021-04:51:15] [V] [TRT] Tactic: 1 time 2.9564
[08/16/2021-04:51:15] [V] [TRT] Tactic: 2 time 4.33075
[08/16/2021-04:51:15] [V] [TRT] Fastest Tactic: 0 Time: 2.35752
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5666160310350604399
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] 
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:15] [V] [TRT] Tactic: 1002 time 0.225928
[08/16/2021-04:51:15] [V] [TRT] Tactic: 0 time 0.222524
[08/16/2021-04:51:15] [V] [TRT] Fastest Tactic: 0 Time: 0.222524
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:15] [V] [TRT] Tactic: 1002 time 0.39108
[08/16/2021-04:51:15] [V] [TRT] Tactic: 0 time 0.140244
[08/16/2021-04:51:15] [V] [TRT] Fastest Tactic: 0 Time: 0.140244
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:15] [V] [TRT] Tactic: 1002 time 0.295368
[08/16/2021-04:51:15] [V] [TRT] Tactic: 0 time 0.141548
[08/16/2021-04:51:15] [V] [TRT] Fastest Tactic: 0 Time: 0.141548
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:15] [V] [TRT] Tactic: 1002 time 0.258552
[08/16/2021-04:51:15] [V] [TRT] Tactic: 0 time 0.214656
[08/16/2021-04:51:15] [V] [TRT] Fastest Tactic: 0 Time: 0.214656
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:15] [V] [TRT] Tactic: 1002 time 0.394332
[08/16/2021-04:51:15] [V] [TRT] Tactic: 0 time 0.114864
[08/16/2021-04:51:15] [V] [TRT] Fastest Tactic: 0 Time: 0.114864
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:15] [V] [TRT] Tactic: 1002 time 0.29688
[08/16/2021-04:51:15] [V] [TRT] Tactic: 0 time 0.106352
[08/16/2021-04:51:15] [V] [TRT] Fastest Tactic: 0 Time: 0.106352
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:15] [V] [TRT] Tactic: 1002 time 0.489184
[08/16/2021-04:51:15] [V] [TRT] Tactic: 0 time 0.156904
[08/16/2021-04:51:15] [V] [TRT] Fastest Tactic: 0 Time: 0.156904
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:15] [V] [TRT] Tactic: 1002 time 0.490392
[08/16/2021-04:51:15] [V] [TRT] Tactic: 0 time 0.112848
[08/16/2021-04:51:15] [V] [TRT] Fastest Tactic: 0 Time: 0.112848
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:15] [V] [TRT] Tactic: 1002 time 0.294536
[08/16/2021-04:51:15] [V] [TRT] Tactic: 0 time 0.106288
[08/16/2021-04:51:15] [V] [TRT] Fastest Tactic: 0 Time: 0.106288
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:15] [V] [TRT] Tactic: 1002 time 0.30254
[08/16/2021-04:51:15] [V] [TRT] Tactic: 0 time 0.138604
[08/16/2021-04:51:15] [V] [TRT] Fastest Tactic: 0 Time: 0.138604
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:15] [V] [TRT] Tactic: 1002 time 0.298068
[08/16/2021-04:51:15] [V] [TRT] Tactic: 0 time 0.094088
[08/16/2021-04:51:15] [V] [TRT] Fastest Tactic: 0 Time: 0.094088
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:15] [V] [TRT] Tactic: 1002 time 0.420624
[08/16/2021-04:51:15] [V] [TRT] Tactic: 0 time 0.09316
[08/16/2021-04:51:15] [V] [TRT] Fastest Tactic: 0 Time: 0.09316
[08/16/2021-04:51:15] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:15] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:16] [V] [TRT] Tactic: 1825138533642645384 time 6.13256
[08/16/2021-04:51:16] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:51:16] [V] [TRT] Tactic: 2842488832350522458 time 6.13433
[08/16/2021-04:51:16] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:16] [V] [TRT] Tactic: 3915320020053085238 time 6.10864
[08/16/2021-04:51:16] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:51:16] [V] [TRT] Tactic: 6448355332020552203 time 6.11006
[08/16/2021-04:51:16] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:16] [V] [TRT] Tactic: 6808617066150061604 time 6.11405
[08/16/2021-04:51:16] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:16] [V] [TRT] Tactic: -8060443123034038864 time 6.17184
[08/16/2021-04:51:16] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:16] [V] [TRT] Tactic: -4420849921117327522 time 6.64068
[08/16/2021-04:51:16] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:16] [V] [TRT] Tactic: -3946921629105938337 time 6.63119
[08/16/2021-04:51:16] [V] [TRT] Fastest Tactic: 3915320020053085238 Time: 6.10864
[08/16/2021-04:51:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:17] [V] [TRT] Tactic: 0 time 9.33041
[08/16/2021-04:51:17] [V] [TRT] Tactic: 2 skipped. Scratch requested: 37748736, available: 16777216
[08/16/2021-04:51:17] [V] [TRT] Tactic: 5 skipped. Scratch requested: 289669120, available: 16777216
[08/16/2021-04:51:17] [V] [TRT] Tactic: 6 time 3.98391
[08/16/2021-04:51:17] [V] [TRT] Tactic: 57 time 8.64122
[08/16/2021-04:51:17] [V] [TRT] Fastest Tactic: 6 Time: 3.98391
[08/16/2021-04:51:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6
[08/16/2021-04:51:17] [V] [TRT] 
[08/16/2021-04:51:17] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:51:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:17] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:17] [V] [TRT] Tactic: 0 time 9.6536
[08/16/2021-04:51:17] [V] [TRT] Tactic: 1 time 6.99295
[08/16/2021-04:51:17] [V] [TRT] Tactic: 2 skipped. Scratch requested: 18874368, available: 16777216
[08/16/2021-04:51:17] [V] [TRT] Tactic: 4 skipped. Scratch requested: 8760590336, available: 16777216
[08/16/2021-04:51:17] [V] [TRT] Tactic: 5 skipped. Scratch requested: 289669120, available: 16777216
[08/16/2021-04:51:17] [V] [TRT] Tactic: 6 skipped. Scratch requested: 17303040, available: 16777216
[08/16/2021-04:51:17] [V] [TRT] Fastest Tactic: 1 Time: 6.99295
[08/16/2021-04:51:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:51:17] [V] [TRT] 
[08/16/2021-04:51:17] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:51:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:51:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:51:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:51:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:17] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:51:17] [V] [TRT] Tactic: 1145226902788474763 time 3.13283
[08/16/2021-04:51:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:17] [V] [TRT] Tactic: 2418518597804310654 time 3.14324
[08/16/2021-04:51:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:17] [V] [TRT] Tactic: 8292881859266835088 time 3.35233
[08/16/2021-04:51:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:17] [V] [TRT] Tactic: 8401509141903434922 time 3.09478
[08/16/2021-04:51:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:17] [V] [TRT] Tactic: -8654297089785671176 time 3.08966
[08/16/2021-04:51:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:51:17] [V] [TRT] Tactic: -7448936905981214224 time 3.51922
[08/16/2021-04:51:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:17] [V] [TRT] Tactic: -3689982367035295496 time 3.09974
[08/16/2021-04:51:17] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:18] [V] [TRT] Tactic: -2027588946874785071 time 3.34632
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:51:18] [V] [TRT] Tactic: -245090590808296743 time 3.1529
[08/16/2021-04:51:18] [V] [TRT] Fastest Tactic: -8654297089785671176 Time: 3.08966
[08/16/2021-04:51:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:18] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8654297089785671176
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:18] [V] [TRT] 
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:18] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:18] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:18] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] Tactic: 3754069740140581927 time 1.00426
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] Tactic: 5925270497649423688 time 0.978364
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] Tactic: 6680916730816870145 time 1.03705
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] Tactic: 7158029511300006471 time 1.01558
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] Tactic: 7859952145590271433 time 1.0419
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] Tactic: 8283847742354150423 time 0.992004
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] Tactic: -4534876761957424274 time 1.00968
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] Tactic: -3237051169894153788 time 1.00197
[08/16/2021-04:51:18] [V] [TRT] Fastest Tactic: 5925270497649423688 Time: 0.978364
[08/16/2021-04:51:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:18] [V] [TRT] Tactic: 0 time 9.19313
[08/16/2021-04:51:18] [V] [TRT] Tactic: 1 time 7.19072
[08/16/2021-04:51:18] [V] [TRT] Tactic: 2 skipped. Scratch requested: 20972032, available: 16777216
[08/16/2021-04:51:18] [V] [TRT] Tactic: 6 skipped. Scratch requested: 17303040, available: 16777216
[08/16/2021-04:51:18] [V] [TRT] Fastest Tactic: 1 Time: 7.19072
[08/16/2021-04:51:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5925270497649423688
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] 
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:18] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,4194304) ***************
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (FusedConvActConvolution)
[08/16/2021-04:51:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (CaskConvolution)
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:18] [V] [TRT] Tactic: 1754569683116234317 time 2.94619
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:18] [V] [TRT] Tactic: 1825138533642645384 time 2.9855
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:18] [V] [TRT] Tactic: 2733356012094739613 time 3.31735
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:18] [V] [TRT] Tactic: 3915320020053085238 time 2.9587
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:18] [V] [TRT] Tactic: 6808617066150061604 time 2.77071
[08/16/2021-04:51:18] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:19] [V] [TRT] Tactic: 9091006216302412844 time 2.67689
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:19] [V] [TRT] Tactic: -8060443123034038864 time 2.79275
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:19] [V] [TRT] Tactic: -4420849921117327522 time 3.82207
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:19] [V] [TRT] Tactic: -3946921629105938337 time 3.31788
[08/16/2021-04:51:19] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 2.67689
[08/16/2021-04:51:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (CudaConvolution)
[08/16/2021-04:51:19] [V] [TRT] Tactic: 0 time 4.34306
[08/16/2021-04:51:19] [V] [TRT] Tactic: 2 time 4.26047
[08/16/2021-04:51:19] [V] [TRT] Tactic: 5 skipped. Scratch requested: 57933824, available: 16777216
[08/16/2021-04:51:19] [V] [TRT] Tactic: 57 time 3.9782
[08/16/2021-04:51:19] [V] [TRT] Fastest Tactic: 57 Time: 3.9782
[08/16/2021-04:51:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[08/16/2021-04:51:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:19] [V] [TRT] 
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:19] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576) -> Half(1,64,4096,4194304) ***************
[08/16/2021-04:51:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (FusedConvActConvolution)
[08/16/2021-04:51:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (CaskConvolution)
[08/16/2021-04:51:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (CudaConvolution)
[08/16/2021-04:51:19] [V] [TRT] Tactic: 0 time 4.40287
[08/16/2021-04:51:19] [V] [TRT] Tactic: 1 time 4.116
[08/16/2021-04:51:19] [V] [TRT] Tactic: 2 time 3.81195
[08/16/2021-04:51:19] [V] [TRT] Tactic: 4 skipped. Scratch requested: 8868069376, available: 16777216
[08/16/2021-04:51:19] [V] [TRT] Tactic: 5 skipped. Scratch requested: 57933824, available: 16777216
[08/16/2021-04:51:19] [V] [TRT] Fastest Tactic: 2 Time: 3.81195
[08/16/2021-04:51:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[08/16/2021-04:51:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2
[08/16/2021-04:51:19] [V] [TRT] 
[08/16/2021-04:51:19] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288) -> Half(1,64,4096:2,2097152) ***************
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (FusedConvActConvolution)
[08/16/2021-04:51:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (CaskConvolution)
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:19] [V] [TRT] Tactic: 2418518597804310654 time 1.44734
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:19] [V] [TRT] Tactic: 8292881859266835088 time 1.78535
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:19] [V] [TRT] Tactic: 8401509141903434922 time 1.42833
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:19] [V] [TRT] Tactic: -8654297089785671176 time 1.62364
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:19] [V] [TRT] Tactic: -7140760933967189247 time 1.40742
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:19] [V] [TRT] Tactic: -4097850214384059472 time 1.64354
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:19] [V] [TRT] Tactic: -3689982367035295496 time 1.62395
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:19] [V] [TRT] Tactic: -2534402059426524406 time 1.40813
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:19] [V] [TRT] Tactic: -2027588946874785071 time 1.72826
[08/16/2021-04:51:19] [V] [TRT] Fastest Tactic: -7140760933967189247 Time: 1.40742
[08/16/2021-04:51:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (CudaConvolution)
[08/16/2021-04:51:19] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[08/16/2021-04:51:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7140760933967189247
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:19] [V] [TRT] 
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:19] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Float(1,64,4096,4194304) ***************
[08/16/2021-04:51:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (FusedConvActConvolution)
[08/16/2021-04:51:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (CaskConvolution)
[08/16/2021-04:51:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (CudaConvolution)
[08/16/2021-04:51:19] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[08/16/2021-04:51:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:19] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Half(128,8192,1:8,524288) ***************
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:19] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (FusedConvActConvolution)
[08/16/2021-04:51:20] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (CaskConvolution)
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] Tactic: 2105695814191699972 time 0.7212
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] Tactic: 3754069740140581927 time 0.674268
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] Tactic: 5666160310350604399 time 0.665632
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] Tactic: 5925270497649423688 time 0.726128
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] Tactic: 6680916730816870145 time 0.82868
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] Tactic: 7158029511300006471 time 0.729044
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] Tactic: 7859952145590271433 time 0.818144
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] Tactic: 8283847742354150423 time 0.668764
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] Tactic: -8391760416076885205 time 0.727572
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] Tactic: -4534876761957424274 time 0.73506
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] Tactic: -3237051169894153788 time 0.722624
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] Tactic: -2422160065350346448 time 0.808456
[08/16/2021-04:51:20] [V] [TRT] Fastest Tactic: 5666160310350604399 Time: 0.665632
[08/16/2021-04:51:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (CudaConvolution)
[08/16/2021-04:51:20] [V] [TRT] Tactic: 0 time 4.73368
[08/16/2021-04:51:20] [V] [TRT] Tactic: 1 time 4.2731
[08/16/2021-04:51:20] [V] [TRT] Tactic: 2 time 4.29915
[08/16/2021-04:51:20] [V] [TRT] Fastest Tactic: 1 Time: 4.2731
[08/16/2021-04:51:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[08/16/2021-04:51:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5666160310350604399
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] 
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:20] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:20] [V] [TRT] Tactic: 1002 time 0.935264
[08/16/2021-04:51:20] [V] [TRT] Tactic: 0 time 0.856988
[08/16/2021-04:51:20] [V] [TRT] Fastest Tactic: 0 Time: 0.856988
[08/16/2021-04:51:20] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:20] [V] [TRT] Tactic: 1002 time 1.4829
[08/16/2021-04:51:20] [V] [TRT] Tactic: 0 time 0.544944
[08/16/2021-04:51:20] [V] [TRT] Fastest Tactic: 0 Time: 0.544944
[08/16/2021-04:51:20] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:20] [V] [TRT] Tactic: 1002 time 1.10243
[08/16/2021-04:51:20] [V] [TRT] Tactic: 0 time 0.551552
[08/16/2021-04:51:20] [V] [TRT] Fastest Tactic: 0 Time: 0.551552
[08/16/2021-04:51:20] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:20] [V] [TRT] Tactic: 1002 time 1.04667
[08/16/2021-04:51:20] [V] [TRT] Tactic: 0 time 0.836812
[08/16/2021-04:51:20] [V] [TRT] Fastest Tactic: 0 Time: 0.836812
[08/16/2021-04:51:20] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:20] [V] [TRT] Tactic: 1002 time 1.48376
[08/16/2021-04:51:20] [V] [TRT] Tactic: 0 time 0.436672
[08/16/2021-04:51:20] [V] [TRT] Fastest Tactic: 0 Time: 0.436672
[08/16/2021-04:51:20] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:20] [V] [TRT] Tactic: 1002 time 1.10899
[08/16/2021-04:51:20] [V] [TRT] Tactic: 0 time 0.3975
[08/16/2021-04:51:20] [V] [TRT] Fastest Tactic: 0 Time: 0.3975
[08/16/2021-04:51:20] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:20] [V] [TRT] Tactic: 1002 time 1.97825
[08/16/2021-04:51:20] [V] [TRT] Tactic: 0 time 0.608668
[08/16/2021-04:51:20] [V] [TRT] Fastest Tactic: 0 Time: 0.608668
[08/16/2021-04:51:20] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:20] [V] [TRT] Tactic: 1002 time 1.97485
[08/16/2021-04:51:20] [V] [TRT] Tactic: 0 time 0.426536
[08/16/2021-04:51:20] [V] [TRT] Fastest Tactic: 0 Time: 0.426536
[08/16/2021-04:51:20] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:20] [V] [TRT] Tactic: 1002 time 1.09989
[08/16/2021-04:51:20] [V] [TRT] Tactic: 0 time 0.403784
[08/16/2021-04:51:20] [V] [TRT] Fastest Tactic: 0 Time: 0.403784
[08/16/2021-04:51:20] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:20] [V] [TRT] Tactic: 1002 time 1.13934
[08/16/2021-04:51:21] [V] [TRT] Tactic: 0 time 0.553772
[08/16/2021-04:51:21] [V] [TRT] Fastest Tactic: 0 Time: 0.553772
[08/16/2021-04:51:21] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:21] [V] [TRT] Tactic: 1002 time 1.10918
[08/16/2021-04:51:21] [V] [TRT] Tactic: 0 time 0.377872
[08/16/2021-04:51:21] [V] [TRT] Fastest Tactic: 0 Time: 0.377872
[08/16/2021-04:51:21] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:21] [V] [TRT] Tactic: 1002 time 1.6222
[08/16/2021-04:51:21] [V] [TRT] Tactic: 0 time 0.362472
[08/16/2021-04:51:21] [V] [TRT] Fastest Tactic: 0 Time: 0.362472
[08/16/2021-04:51:21] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,8388608), Float(1,64,4096,4194304) -> Float(1,64,4096,4194304) ***************
[08/16/2021-04:51:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:21] [V] [TRT] Tactic: 1754569683116234317 time 5.62298
[08/16/2021-04:51:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:21] [V] [TRT] Tactic: 1825138533642645384 time 5.66425
[08/16/2021-04:51:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:21] [V] [TRT] Tactic: 2733356012094739613 time 11.6984
[08/16/2021-04:51:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:21] [V] [TRT] Tactic: 3915320020053085238 time 5.60171
[08/16/2021-04:51:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:21] [V] [TRT] Tactic: 6808617066150061604 time 6.47662
[08/16/2021-04:51:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:21] [V] [TRT] Tactic: 9091006216302412844 time 6.49553
[08/16/2021-04:51:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:21] [V] [TRT] Tactic: -8060443123034038864 time 6.47819
[08/16/2021-04:51:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:22] [V] [TRT] Tactic: -4420849921117327522 time 11.8785
[08/16/2021-04:51:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:22] [V] [TRT] Tactic: -3946921629105938337 time 11.7171
[08/16/2021-04:51:22] [V] [TRT] Fastest Tactic: 3915320020053085238 Time: 5.60171
[08/16/2021-04:51:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:22] [V] [TRT] Tactic: 0 time 9.40072
[08/16/2021-04:51:22] [V] [TRT] Tactic: 2 time 9.82016
[08/16/2021-04:51:22] [V] [TRT] Tactic: 57 time 8.9902
[08/16/2021-04:51:22] [V] [TRT] Fastest Tactic: 57 Time: 8.9902
[08/16/2021-04:51:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3915320020053085238
[08/16/2021-04:51:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:22] [V] [TRT] 
[08/16/2021-04:51:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:22] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,8388608), Half(1,64,4096,4194304) -> Half(1,64,4096,4194304) ***************
[08/16/2021-04:51:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:23] [V] [TRT] Tactic: 0 time 10.7795
[08/16/2021-04:51:23] [V] [TRT] Tactic: 1 time 7.4794
[08/16/2021-04:51:23] [V] [TRT] Tactic: 2 time 7.8261
[08/16/2021-04:51:23] [V] [TRT] Fastest Tactic: 1 Time: 7.4794
[08/16/2021-04:51:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:51:23] [V] [TRT] 
[08/16/2021-04:51:23] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,4194304), Half(1,64,4096:2,2097152) -> Half(1,64,4096:2,2097152) ***************
[08/16/2021-04:51:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:23] [V] [TRT] Tactic: 2418518597804310654 time 3.28905
[08/16/2021-04:51:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:23] [V] [TRT] Tactic: 8292881859266835088 time 6.08377
[08/16/2021-04:51:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:23] [V] [TRT] Tactic: 8401509141903434922 time 3.6031
[08/16/2021-04:51:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:23] [V] [TRT] Tactic: -8654297089785671176 time 3.08329
[08/16/2021-04:51:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:23] [V] [TRT] Tactic: -7140760933967189247 time 3.50262
[08/16/2021-04:51:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:23] [V] [TRT] Tactic: -4097850214384059472 time 6.91561
[08/16/2021-04:51:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:23] [V] [TRT] Tactic: -3689982367035295496 time 3.5579
[08/16/2021-04:51:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:23] [V] [TRT] Tactic: -2534402059426524406 time 3.0998
[08/16/2021-04:51:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:24] [V] [TRT] Tactic: -2027588946874785071 time 6.0001
[08/16/2021-04:51:24] [V] [TRT] Fastest Tactic: -8654297089785671176 Time: 3.08329
[08/16/2021-04:51:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:24] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8654297089785671176
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:24] [V] [TRT] 
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:24] [V] [TRT] *************** Autotuning format combination: Half(64,8192,1:8,1048576), Float(1,64,4096,4194304) -> Float(1,64,4096,4194304) ***************
[08/16/2021-04:51:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:24] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:24] [V] [TRT] *************** Autotuning format combination: Half(64,8192,1:8,1048576), Half(128,8192,1:8,524288) -> Half(128,8192,1:8,524288) ***************
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] Tactic: 2105695814191699972 time 1.31898
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] Tactic: 3754069740140581927 time 1.18427
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] Tactic: 5666160310350604399 time 1.19353
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] Tactic: 5925270497649423688 time 1.19094
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] Tactic: 6680916730816870145 time 1.49976
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] Tactic: 7158029511300006471 time 1.30152
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] Tactic: 7859952145590271433 time 1.48368
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] Tactic: 8283847742354150423 time 1.17864
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] Tactic: -8391760416076885205 time 1.2112
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] Tactic: -4534876761957424274 time 1.21125
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] Tactic: -3237051169894153788 time 1.30983
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] Tactic: -2422160065350346448 time 1.45838
[08/16/2021-04:51:24] [V] [TRT] Fastest Tactic: 8283847742354150423 Time: 1.17864
[08/16/2021-04:51:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:24] [V] [TRT] Tactic: 0 time 9.53898
[08/16/2021-04:51:24] [V] [TRT] Tactic: 1 skipped. Scratch requested: 26239488, available: 16777216
[08/16/2021-04:51:24] [V] [TRT] Tactic: 2 time 10.3198
[08/16/2021-04:51:24] [V] [TRT] Fastest Tactic: 0 Time: 9.53898
[08/16/2021-04:51:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8283847742354150423
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] 
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:24] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:24] [V] [TRT] Tactic: 1002 time 0.880196
[08/16/2021-04:51:24] [V] [TRT] Tactic: 0 time 0.8575
[08/16/2021-04:51:24] [V] [TRT] Fastest Tactic: 0 Time: 0.8575
[08/16/2021-04:51:24] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:24] [V] [TRT] Tactic: 1002 time 1.47648
[08/16/2021-04:51:24] [V] [TRT] Tactic: 0 time 0.543544
[08/16/2021-04:51:24] [V] [TRT] Fastest Tactic: 0 Time: 0.543544
[08/16/2021-04:51:24] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:24] [V] [TRT] Tactic: 1002 time 1.09886
[08/16/2021-04:51:24] [V] [TRT] Tactic: 0 time 0.54742
[08/16/2021-04:51:24] [V] [TRT] Fastest Tactic: 0 Time: 0.54742
[08/16/2021-04:51:24] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:24] [V] [TRT] Tactic: 1002 time 1.03504
[08/16/2021-04:51:25] [V] [TRT] Tactic: 0 time 0.837
[08/16/2021-04:51:25] [V] [TRT] Fastest Tactic: 0 Time: 0.837
[08/16/2021-04:51:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:25] [V] [TRT] Tactic: 1002 time 1.48684
[08/16/2021-04:51:25] [V] [TRT] Tactic: 0 time 0.440108
[08/16/2021-04:51:25] [V] [TRT] Fastest Tactic: 0 Time: 0.440108
[08/16/2021-04:51:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:25] [V] [TRT] Tactic: 1002 time 1.11244
[08/16/2021-04:51:25] [V] [TRT] Tactic: 0 time 0.398688
[08/16/2021-04:51:25] [V] [TRT] Fastest Tactic: 0 Time: 0.398688
[08/16/2021-04:51:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:25] [V] [TRT] Tactic: 1002 time 1.98796
[08/16/2021-04:51:25] [V] [TRT] Tactic: 0 time 0.610648
[08/16/2021-04:51:25] [V] [TRT] Fastest Tactic: 0 Time: 0.610648
[08/16/2021-04:51:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:25] [V] [TRT] Tactic: 1002 time 1.96944
[08/16/2021-04:51:25] [V] [TRT] Tactic: 0 time 0.42984
[08/16/2021-04:51:25] [V] [TRT] Fastest Tactic: 0 Time: 0.42984
[08/16/2021-04:51:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:25] [V] [TRT] Tactic: 1002 time 1.09981
[08/16/2021-04:51:25] [V] [TRT] Tactic: 0 time 0.401616
[08/16/2021-04:51:25] [V] [TRT] Fastest Tactic: 0 Time: 0.401616
[08/16/2021-04:51:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:25] [V] [TRT] Tactic: 1002 time 1.13903
[08/16/2021-04:51:25] [V] [TRT] Tactic: 0 time 0.554592
[08/16/2021-04:51:25] [V] [TRT] Fastest Tactic: 0 Time: 0.554592
[08/16/2021-04:51:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:25] [V] [TRT] Tactic: 1002 time 1.11476
[08/16/2021-04:51:25] [V] [TRT] Tactic: 0 time 0.361688
[08/16/2021-04:51:25] [V] [TRT] Fastest Tactic: 0 Time: 0.361688
[08/16/2021-04:51:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:25] [V] [TRT] Tactic: 1002 time 1.62249
[08/16/2021-04:51:25] [V] [TRT] Tactic: 0 time 0.360168
[08/16/2021-04:51:25] [V] [TRT] Fastest Tactic: 0 Time: 0.360168
[08/16/2021-04:51:25] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,4194304) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:25] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:25] [V] [TRT] Tactic: 1754569683116234317 time 2.80554
[08/16/2021-04:51:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:25] [V] [TRT] Tactic: 1825138533642645384 time 2.78408
[08/16/2021-04:51:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:25] [V] [TRT] Tactic: 2733356012094739613 time 3.32103
[08/16/2021-04:51:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:25] [V] [TRT] Tactic: 3915320020053085238 time 2.74533
[08/16/2021-04:51:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:25] [V] [TRT] Tactic: 6808617066150061604 time 2.78026
[08/16/2021-04:51:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:25] [V] [TRT] Tactic: 9091006216302412844 time 2.79408
[08/16/2021-04:51:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:25] [V] [TRT] Tactic: -8060443123034038864 time 2.79311
[08/16/2021-04:51:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:25] [V] [TRT] Tactic: -4420849921117327522 time 3.62934
[08/16/2021-04:51:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:25] [V] [TRT] Tactic: -3946921629105938337 time 3.25686
[08/16/2021-04:51:25] [V] [TRT] Fastest Tactic: 3915320020053085238 Time: 2.74533
[08/16/2021-04:51:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:26] [V] [TRT] Tactic: 0 time 4.39786
[08/16/2021-04:51:26] [V] [TRT] Tactic: 2 time 4.90582
[08/16/2021-04:51:26] [V] [TRT] Tactic: 5 skipped. Scratch requested: 57933824, available: 16777216
[08/16/2021-04:51:26] [V] [TRT] Tactic: 57 time 4.5566
[08/16/2021-04:51:26] [V] [TRT] Fastest Tactic: 0 Time: 4.39786
[08/16/2021-04:51:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3915320020053085238
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:26] [V] [TRT] 
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:26] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,4194304) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:51:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:26] [V] [TRT] Tactic: 0 time 4.47069
[08/16/2021-04:51:26] [V] [TRT] Tactic: 1 time 3.47804
[08/16/2021-04:51:26] [V] [TRT] Tactic: 2 time 4.33891
[08/16/2021-04:51:26] [V] [TRT] Tactic: 4 skipped. Scratch requested: 8894021632, available: 16777216
[08/16/2021-04:51:26] [V] [TRT] Tactic: 5 skipped. Scratch requested: 57933824, available: 16777216
[08/16/2021-04:51:26] [V] [TRT] Fastest Tactic: 1 Time: 3.47804
[08/16/2021-04:51:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:51:26] [V] [TRT] 
[08/16/2021-04:51:26] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,2097152) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: 2418518597804310654 time 1.48937
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: 8292881859266835088 time 1.68564
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: 8401509141903434922 time 1.47312
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: -8654297089785671176 time 1.43419
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: -7140760933967189247 time 1.41508
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: -4097850214384059472 time 1.57051
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: -3689982367035295496 time 1.42852
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: -2534402059426524406 time 1.4078
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: -2027588946874785071 time 1.63636
[08/16/2021-04:51:26] [V] [TRT] Fastest Tactic: -2534402059426524406 Time: 1.4078
[08/16/2021-04:51:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:26] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2534402059426524406
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:26] [V] [TRT] 
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:26] [V] [TRT] *************** Autotuning format combination: Half(128,8192,1:8,524288) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:26] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:26] [V] [TRT] *************** Autotuning format combination: Half(128,8192,1:8,524288) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: 2105695814191699972 time 0.567076
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: 3754069740140581927 time 0.512556
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: 5666160310350604399 time 0.516232
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: 5925270497649423688 time 0.505764
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: 6680916730816870145 time 0.57428
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: 7158029511300006471 time 0.562428
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: 7859952145590271433 time 0.572624
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: 8283847742354150423 time 0.510892
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: -8391760416076885205 time 0.516852
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: -4534876761957424274 time 0.518332
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: -3237051169894153788 time 0.555096
[08/16/2021-04:51:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:26] [V] [TRT] Tactic: -2422160065350346448 time 0.558296
[08/16/2021-04:51:26] [V] [TRT] Fastest Tactic: 5925270497649423688 Time: 0.505764
[08/16/2021-04:51:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:27] [V] [TRT] Tactic: 0 time 4.36949
[08/16/2021-04:51:27] [V] [TRT] Tactic: 1 time 4.61083
[08/16/2021-04:51:27] [V] [TRT] Tactic: 2 time 8.50738
[08/16/2021-04:51:27] [V] [TRT] Fastest Tactic: 0 Time: 4.36949
[08/16/2021-04:51:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:27] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5925270497649423688
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:27] [V] [TRT] 
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:27] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:27] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:51:27] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:51:27] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:27] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:27] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:27] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:27] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:27] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:51:27] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576), Float(1,64,4096,4194304) -> Float(1,64,4096,4194304) ***************
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:27] [V] [TRT] Tactic: 1754569683116234317 time 3.10145
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:27] [V] [TRT] Tactic: 1825138533642645384 time 3.11399
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:27] [V] [TRT] Tactic: 2733356012094739613 time 3.63453
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:27] [V] [TRT] Tactic: 3915320020053085238 time 3.14621
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:27] [V] [TRT] Tactic: 6808617066150061604 time 2.86155
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:27] [V] [TRT] Tactic: 9091006216302412844 time 2.79943
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:27] [V] [TRT] Tactic: -8060443123034038864 time 2.88996
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:27] [V] [TRT] Tactic: -4420849921117327522 time 4.14431
[08/16/2021-04:51:27] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:27] [V] [TRT] Tactic: -3946921629105938337 time 3.68984
[08/16/2021-04:51:27] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 2.79943
[08/16/2021-04:51:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:28] [V] [TRT] Tactic: 0 time 6.09704
[08/16/2021-04:51:28] [V] [TRT] Tactic: 2 time 6.0623
[08/16/2021-04:51:28] [V] [TRT] Tactic: 5 skipped. Scratch requested: 57933824, available: 16777216
[08/16/2021-04:51:28] [V] [TRT] Tactic: 57 time 5.78191
[08/16/2021-04:51:28] [V] [TRT] Fastest Tactic: 57 Time: 5.78191
[08/16/2021-04:51:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:28] [V] [TRT] 
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:28] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576), Half(1,64,4096,4194304) -> Half(1,64,4096,4194304) ***************
[08/16/2021-04:51:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:28] [V] [TRT] Tactic: 0 time 5.40517
[08/16/2021-04:51:28] [V] [TRT] Tactic: 1 time 4.89979
[08/16/2021-04:51:28] [V] [TRT] Tactic: 2 time 4.83357
[08/16/2021-04:51:28] [V] [TRT] Tactic: 4 skipped. Scratch requested: 8868069376, available: 16777216
[08/16/2021-04:51:28] [V] [TRT] Tactic: 5 skipped. Scratch requested: 57933824, available: 16777216
[08/16/2021-04:51:28] [V] [TRT] Fastest Tactic: 2 Time: 4.83357
[08/16/2021-04:51:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2
[08/16/2021-04:51:28] [V] [TRT] 
[08/16/2021-04:51:28] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288), Half(1,64,4096:2,2097152) -> Half(1,64,4096:2,2097152) ***************
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:28] [V] [TRT] Tactic: 2418518597804310654 time 1.6284
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:28] [V] [TRT] Tactic: 8292881859266835088 time 1.93247
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:28] [V] [TRT] Tactic: 8401509141903434922 time 1.47673
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:28] [V] [TRT] Tactic: -8654297089785671176 time 1.73847
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:28] [V] [TRT] Tactic: -7140760933967189247 time 1.45459
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:28] [V] [TRT] Tactic: -4097850214384059472 time 1.8097
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:28] [V] [TRT] Tactic: -3689982367035295496 time 1.73666
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:28] [V] [TRT] Tactic: -2534402059426524406 time 1.4747
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:28] [V] [TRT] Tactic: -2027588946874785071 time 1.86782
[08/16/2021-04:51:28] [V] [TRT] Fastest Tactic: -7140760933967189247 Time: 1.45459
[08/16/2021-04:51:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:28] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7140760933967189247
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:28] [V] [TRT] 
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:28] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072), Float(1,64,4096,4194304) -> Float(1,64,4096,4194304) ***************
[08/16/2021-04:51:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:28] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:28] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072), Half(128,8192,1:8,524288) -> Half(128,8192,1:8,524288) ***************
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:28] [V] [TRT] Tactic: 2105695814191699972 time 0.836328
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:28] [V] [TRT] Tactic: 3754069740140581927 time 0.784752
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:28] [V] [TRT] Tactic: 5666160310350604399 time 0.78264
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:28] [V] [TRT] Tactic: 5925270497649423688 time 0.819932
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:28] [V] [TRT] Tactic: 6680916730816870145 time 1.02686
[08/16/2021-04:51:28] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] Tactic: 7158029511300006471 time 0.840704
[08/16/2021-04:51:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] Tactic: 7859952145590271433 time 1.01471
[08/16/2021-04:51:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] Tactic: 8283847742354150423 time 0.800968
[08/16/2021-04:51:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] Tactic: -8391760416076885205 time 0.813664
[08/16/2021-04:51:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] Tactic: -4534876761957424274 time 0.817624
[08/16/2021-04:51:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] Tactic: -3237051169894153788 time 0.83582
[08/16/2021-04:51:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] Tactic: -2422160065350346448 time 1.00342
[08/16/2021-04:51:29] [V] [TRT] Fastest Tactic: 5666160310350604399 Time: 0.78264
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:29] [V] [TRT] Tactic: 0 time 5.73103
[08/16/2021-04:51:29] [V] [TRT] Tactic: 1 time 5.26473
[08/16/2021-04:51:29] [V] [TRT] Tactic: 2 time 5.32663
[08/16/2021-04:51:29] [V] [TRT] Fastest Tactic: 1 Time: 5.26473
[08/16/2021-04:51:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5666160310350604399
[08/16/2021-04:51:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] 
[08/16/2021-04:51:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,4194304) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,4194304) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,2097152) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(128,8192,1:8,524288) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:29] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(128,8192,1:8,524288) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:29] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576), Float(1,64,4096,4194304) -> Float(1,64,4096,4194304) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576), Half(1,64,4096,4194304) -> Half(1,64,4096,4194304) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288), Half(1,64,4096:2,2097152) -> Half(1,64,4096:2,2097152) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072), Float(1,64,4096,4194304) -> Float(1,64,4096,4194304) ***************
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:29] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072), Half(128,8192,1:8,524288) -> Half(128,8192,1:8,524288) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,4194304) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,4194304) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,2097152) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(128,8192,1:8,524288) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:29] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(128,8192,1:8,524288) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:29] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576), Float(1,64,4096,4194304) -> Float(1,64,4096,4194304) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576), Half(1,64,4096,4194304) -> Half(1,64,4096,4194304) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288), Half(1,64,4096:2,2097152) -> Half(1,64,4096:2,2097152) ***************
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072), Float(1,64,4096,4194304) -> Float(1,64,4096,4194304) ***************
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:29] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:29] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072), Half(128,8192,1:8,524288) -> Half(128,8192,1:8,524288) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,4194304) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,4194304) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,2097152) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(128,8192,1:8,524288) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:30] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(128,8192,1:8,524288) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:30] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576), Float(1,64,4096,4194304) -> Float(1,64,4096,4194304) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576), Half(1,64,4096,4194304) -> Half(1,64,4096,4194304) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288), Half(1,64,4096:2,2097152) -> Half(1,64,4096:2,2097152) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072), Float(1,64,4096,4194304) -> Float(1,64,4096,4194304) ***************
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:30] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072), Half(128,8192,1:8,524288) -> Half(128,8192,1:8,524288) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,4194304) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,4194304) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,2097152) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(128,8192,1:8,524288) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:30] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(128,8192,1:8,524288) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:30] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576), Float(1,64,4096,4194304) -> Float(1,64,4096,4194304) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576), Half(1,64,4096,4194304) -> Half(1,64,4096,4194304) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288), Half(1,64,4096:2,2097152) -> Half(1,64,4096:2,2097152) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072), Float(1,64,4096,4194304) -> Float(1,64,4096,4194304) ***************
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_out/Relu6 (CaskConvolution)
[08/16/2021-04:51:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_out/Relu6 (CudaConvolution)
[08/16/2021-04:51:30] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072), Half(128,8192,1:8,524288) -> Half(128,8192,1:8,524288) ***************
[08/16/2021-04:51:30] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,4194304) -> Float(1,32,1024,524288) ***************
[08/16/2021-04:51:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:30] [V] [TRT] Tactic: 1754569683116234317 time 1.47703
[08/16/2021-04:51:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:30] [V] [TRT] Tactic: 1825138533642645384 time 1.48496
[08/16/2021-04:51:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:30] [V] [TRT] Tactic: 2733356012094739613 time 1.74577
[08/16/2021-04:51:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:30] [V] [TRT] Tactic: 3915320020053085238 time 1.47579
[08/16/2021-04:51:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:30] [V] [TRT] Tactic: 6808617066150061604 time 1.46923
[08/16/2021-04:51:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:30] [V] [TRT] Tactic: 9091006216302412844 time 1.44144
[08/16/2021-04:51:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:30] [V] [TRT] Tactic: -8060443123034038864 time 1.48914
[08/16/2021-04:51:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:30] [V] [TRT] Tactic: -4420849921117327522 time 1.83715
[08/16/2021-04:51:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:30] [V] [TRT] Tactic: -3946921629105938337 time 1.90775
[08/16/2021-04:51:30] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 1.44144
[08/16/2021-04:51:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:31] [V] [TRT] Tactic: 0 time 2.74153
[08/16/2021-04:51:31] [V] [TRT] Tactic: 2 time 2.5561
[08/16/2021-04:51:31] [V] [TRT] Tactic: 57 time 2.69748
[08/16/2021-04:51:31] [V] [TRT] Fastest Tactic: 2 Time: 2.5561
[08/16/2021-04:51:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:31] [V] [TRT] 
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:51:31] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,4194304) -> Half(1,32,1024,524288) ***************
[08/16/2021-04:51:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:31] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:31] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:31] [V] [TRT] Tactic: 0 time 2.41371
[08/16/2021-04:51:31] [V] [TRT] Tactic: 1 time 2.48435
[08/16/2021-04:51:31] [V] [TRT] Tactic: 2 time 2.17679
[08/16/2021-04:51:31] [V] [TRT] Fastest Tactic: 2 Time: 2.17679
[08/16/2021-04:51:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2
[08/16/2021-04:51:31] [V] [TRT] 
[08/16/2021-04:51:31] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,2097152) -> Half(1,32,1024:2,262144) ***************
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:31] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: 2418518597804310654 time 0.73908
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: 8292881859266835088 time 0.909928
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: 8401509141903434922 time 0.729792
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: -8654297089785671176 time 0.786876
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: -7140760933967189247 time 0.735076
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: -4097850214384059472 time 0.930964
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: -3689982367035295496 time 0.784584
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: -2534402059426524406 time 0.754984
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: -2027588946874785071 time 1.06009
[08/16/2021-04:51:31] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 0.729792
[08/16/2021-04:51:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:31] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:31] [V] [TRT] 
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:31] [V] [TRT] *************** Autotuning format combination: Half(128,8192,1:8,524288) -> Float(1,32,1024,524288) ***************
[08/16/2021-04:51:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:31] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:31] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:31] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:31] [V] [TRT] *************** Autotuning format combination: Half(128,8192,1:8,524288) -> Half(64,2048,1:8,65536) ***************
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:31] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: 2105695814191699972 time 0.288508
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: 3754069740140581927 time 0.266016
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: 5666160310350604399 time 0.26288
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: 5925270497649423688 time 0.269208
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: 6680916730816870145 time 0.315044
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: 7158029511300006471 time 0.284852
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: 7859952145590271433 time 0.31288
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: 8283847742354150423 time 0.26234
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: -8391760416076885205 time 0.267116
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: -4534876761957424274 time 0.279332
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: -3237051169894153788 time 0.283976
[08/16/2021-04:51:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:31] [V] [TRT] Tactic: -2422160065350346448 time 0.30642
[08/16/2021-04:51:31] [V] [TRT] Fastest Tactic: 8283847742354150423 Time: 0.26234
[08/16/2021-04:51:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:36] [V] [TRT] Tactic: 0 time 329.106
[08/16/2021-04:51:37] [V] [TRT] Tactic: 1 time 2.94659
[08/16/2021-04:51:37] [V] [TRT] Tactic: 2 time 2.30817
[08/16/2021-04:51:37] [V] [TRT] Fastest Tactic: 2 Time: 2.30817
[08/16/2021-04:51:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8283847742354150423
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:37] [V] [TRT] 
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:51:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:37] [V] [TRT] Tactic: 1002 time 0.117188
[08/16/2021-04:51:37] [V] [TRT] Tactic: 0 time 0.116504
[08/16/2021-04:51:37] [V] [TRT] Fastest Tactic: 0 Time: 0.116504
[08/16/2021-04:51:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:37] [V] [TRT] Tactic: 1002 time 0.208116
[08/16/2021-04:51:37] [V] [TRT] Tactic: 0 time 0.074044
[08/16/2021-04:51:37] [V] [TRT] Fastest Tactic: 0 Time: 0.074044
[08/16/2021-04:51:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:37] [V] [TRT] Tactic: 1002 time 0.153412
[08/16/2021-04:51:37] [V] [TRT] Tactic: 0 time 0.074216
[08/16/2021-04:51:37] [V] [TRT] Fastest Tactic: 0 Time: 0.074216
[08/16/2021-04:51:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:37] [V] [TRT] Tactic: 1002 time 0.131588
[08/16/2021-04:51:37] [V] [TRT] Tactic: 0 time 0.110312
[08/16/2021-04:51:37] [V] [TRT] Fastest Tactic: 0 Time: 0.110312
[08/16/2021-04:51:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:37] [V] [TRT] Tactic: 1002 time 0.206144
[08/16/2021-04:51:37] [V] [TRT] Tactic: 0 time 0.060456
[08/16/2021-04:51:37] [V] [TRT] Fastest Tactic: 0 Time: 0.060456
[08/16/2021-04:51:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:37] [V] [TRT] Tactic: 1002 time 0.15422
[08/16/2021-04:51:37] [V] [TRT] Tactic: 0 time 0.05712
[08/16/2021-04:51:37] [V] [TRT] Fastest Tactic: 0 Time: 0.05712
[08/16/2021-04:51:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:37] [V] [TRT] Tactic: 1002 time 0.252224
[08/16/2021-04:51:37] [V] [TRT] Tactic: 0 time 0.082552
[08/16/2021-04:51:37] [V] [TRT] Fastest Tactic: 0 Time: 0.082552
[08/16/2021-04:51:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:37] [V] [TRT] Tactic: 1002 time 0.251188
[08/16/2021-04:51:37] [V] [TRT] Tactic: 0 time 0.058576
[08/16/2021-04:51:37] [V] [TRT] Fastest Tactic: 0 Time: 0.058576
[08/16/2021-04:51:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:37] [V] [TRT] Tactic: 1002 time 0.153888
[08/16/2021-04:51:37] [V] [TRT] Tactic: 0 time 0.056588
[08/16/2021-04:51:37] [V] [TRT] Fastest Tactic: 0 Time: 0.056588
[08/16/2021-04:51:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:37] [V] [TRT] Tactic: 1002 time 0.156204
[08/16/2021-04:51:37] [V] [TRT] Tactic: 0 time 0.072336
[08/16/2021-04:51:37] [V] [TRT] Fastest Tactic: 0 Time: 0.072336
[08/16/2021-04:51:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:37] [V] [TRT] Tactic: 1002 time 0.154824
[08/16/2021-04:51:37] [V] [TRT] Tactic: 0 time 0.050008
[08/16/2021-04:51:37] [V] [TRT] Fastest Tactic: 0 Time: 0.050008
[08/16/2021-04:51:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:51:37] [V] [TRT] Tactic: 1002 time 0.223536
[08/16/2021-04:51:37] [V] [TRT] Tactic: 0 time 0.050552
[08/16/2021-04:51:37] [V] [TRT] Fastest Tactic: 0 Time: 0.050552
[08/16/2021-04:51:37] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,524288) ***************
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:37] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:37] [V] [TRT] Tactic: 524287 time 8.31711
[08/16/2021-04:51:38] [V] [TRT] Tactic: 720895 time 8.28785
[08/16/2021-04:51:38] [V] [TRT] Tactic: 983039 time 7.44088
[08/16/2021-04:51:38] [V] [TRT] Tactic: 1048575 time 7.5401
[08/16/2021-04:51:39] [V] [TRT] Tactic: 1703935 time 7.4339
[08/16/2021-04:51:39] [V] [TRT] Tactic: 1769471 time 9.32915
[08/16/2021-04:51:39] [V] [TRT] Tactic: 1966079 time 6.67628
[08/16/2021-04:51:40] [V] [TRT] Tactic: 2031615 time 8.76374
[08/16/2021-04:51:40] [V] [TRT] Tactic: 2228223 time 7.25822
[08/16/2021-04:51:41] [V] [TRT] Tactic: 2424831 time 7.17373
[08/16/2021-04:51:41] [V] [TRT] Tactic: 2621439 time 7.55644
[08/16/2021-04:51:41] [V] [TRT] Tactic: 2752511 time 7.71716
[08/16/2021-04:51:42] [V] [TRT] Tactic: 2818047 time 8.20349
[08/16/2021-04:51:42] [V] [TRT] Tactic: 2883583 time 8.21967
[08/16/2021-04:51:42] [V] [TRT] Tactic: 3014655 time 6.95212
[08/16/2021-04:51:43] [V] [TRT] Tactic: 3145727 time 7.51785
[08/16/2021-04:51:43] [V] [TRT] Tactic: 3473407 time 9.41208
[08/16/2021-04:51:44] [V] [TRT] Tactic: 3604479 time 6.89548
[08/16/2021-04:51:44] [V] [TRT] Tactic: 3735551 time 15.895
[08/16/2021-04:51:45] [V] [TRT] Tactic: 4390911 time 7.68616
[08/16/2021-04:51:45] [V] [TRT] Tactic: 5046271 time 9.44491
[08/16/2021-04:51:45] [V] [TRT] Tactic: 5963775 time 7.4447
[08/16/2021-04:51:46] [V] [TRT] Tactic: 6160383 time 8.49067
[08/16/2021-04:51:46] [V] [TRT] Tactic: 6488063 time 7.88832
[08/16/2021-04:51:47] [V] [TRT] Tactic: 6881279 time 8.87114
[08/16/2021-04:51:47] [V] [TRT] Tactic: 7274495 time 10.8781
[08/16/2021-04:51:48] [V] [TRT] Tactic: 7864319 time 8.28684
[08/16/2021-04:51:48] [V] [TRT] Tactic: 7995391 time 6.76147
[08/16/2021-04:51:48] [V] [TRT] Tactic: 8585215 time 8.13226
[08/16/2021-04:51:49] [V] [TRT] Tactic: 8847359 time 9.1701
[08/16/2021-04:51:49] [V] [TRT] Tactic: 8978431 time 7.42672
[08/16/2021-04:51:49] [V] [TRT] Tactic: 9043967 time 7.57992
[08/16/2021-04:51:50] [V] [TRT] Tactic: 9175039 time 6.89311
[08/16/2021-04:51:50] [V] [TRT] Tactic: 9502719 time 7.56486
[08/16/2021-04:51:51] [V] [TRT] Tactic: 9830399 time 11.0196
[08/16/2021-04:51:51] [V] [TRT] Tactic: 9961471 time 7.90753
[08/16/2021-04:51:51] [V] [TRT] Tactic: 10027007 time 8.2496
[08/16/2021-04:51:52] [V] [TRT] Tactic: 10092543 time 7.72914
[08/16/2021-04:51:52] [V] [TRT] Tactic: 10289151 time 6.5519
[08/16/2021-04:51:53] [V] [TRT] Tactic: 10485759 time 8.39132
[08/16/2021-04:51:53] [V] [TRT] Tactic: 10682367 time 7.50354
[08/16/2021-04:51:53] [V] [TRT] Tactic: 10813439 time 6.43558
[08/16/2021-04:51:53] [V] [TRT] Fastest Tactic: 10813439 Time: 6.43558
[08/16/2021-04:51:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:53] [V] [TRT] Tactic: 1825138533642645384 time 6.49052
[08/16/2021-04:51:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:51:53] [V] [TRT] Tactic: 2842488832350522458 time 6.0435
[08/16/2021-04:51:53] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:54] [V] [TRT] Tactic: 3915320020053085238 time 6.4604
[08/16/2021-04:51:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:51:54] [V] [TRT] Tactic: 6448355332020552203 time 6.68297
[08/16/2021-04:51:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:54] [V] [TRT] Tactic: 6808617066150061604 time 6.10341
[08/16/2021-04:51:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:54] [V] [TRT] Tactic: -8060443123034038864 time 6.15792
[08/16/2021-04:51:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:54] [V] [TRT] Tactic: -4420849921117327522 time 7.11713
[08/16/2021-04:51:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:54] [V] [TRT] Tactic: -3946921629105938337 time 7.04373
[08/16/2021-04:51:54] [V] [TRT] Fastest Tactic: 2842488832350522458 Time: 6.0435
[08/16/2021-04:51:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:54] [V] [TRT] Tactic: 0 time 9.39117
[08/16/2021-04:51:54] [V] [TRT] Tactic: 2 skipped. Scratch requested: 18874368, available: 16777216
[08/16/2021-04:51:54] [V] [TRT] Tactic: 5 skipped. Scratch requested: 1149763584, available: 16777216
[08/16/2021-04:51:54] [V] [TRT] Tactic: 6 skipped. Scratch requested: 26216448, available: 16777216
[08/16/2021-04:51:54] [V] [TRT] Tactic: 57 skipped. Scratch requested: 23075328, available: 16777216
[08/16/2021-04:51:54] [V] [TRT] Fastest Tactic: 0 Time: 9.39117
[08/16/2021-04:51:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:54] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2842488832350522458
[08/16/2021-04:51:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:51:54] [V] [TRT] 
[08/16/2021-04:51:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:51:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:51:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:51:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:51:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:51:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:51:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:51:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:51:54] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:51:54] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,524288) -> Half(1,32,1024,524288) ***************
[08/16/2021-04:51:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:54] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:51:54] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:51:55] [V] [TRT] Tactic: 0 time 9.92224
[08/16/2021-04:51:55] [V] [TRT] Tactic: 1 time 6.85617
[08/16/2021-04:51:55] [V] [TRT] Tactic: 2 time 8.42171
[08/16/2021-04:51:55] [V] [TRT] Tactic: 4 skipped. Scratch requested: 8885108736, available: 16777216
[08/16/2021-04:51:55] [V] [TRT] Tactic: 5 skipped. Scratch requested: 1149763584, available: 16777216
[08/16/2021-04:51:55] [V] [TRT] Tactic: 6 skipped. Scratch requested: 39848448, available: 16777216
[08/16/2021-04:51:55] [V] [TRT] Fastest Tactic: 1 Time: 6.85617
[08/16/2021-04:51:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:51:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:51:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:51:55] [V] [TRT] 
[08/16/2021-04:51:55] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,262144) -> Half(1,32,1024:2,262144) ***************
[08/16/2021-04:51:55] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:51:55] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:51:55] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:51:55] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:51:55] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:51:55] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:51:55] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:51:55] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:51:55] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:51:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:51:55] [V] [TRT] Tactic: 524287 time 4.37108
[08/16/2021-04:51:55] [V] [TRT] Tactic: 720895 time 4.47113
[08/16/2021-04:51:56] [V] [TRT] Tactic: 983039 time 3.71821
[08/16/2021-04:51:56] [V] [TRT] Tactic: 1048575 time 4.24916
[08/16/2021-04:51:56] [V] [TRT] Tactic: 1703935 time 4.24574
[08/16/2021-04:51:56] [V] [TRT] Tactic: 1769471 time 4.69732
[08/16/2021-04:51:56] [V] [TRT] Tactic: 1966079 time 3.30989
[08/16/2021-04:51:57] [V] [TRT] Tactic: 2031615 time 4.13328
[08/16/2021-04:51:57] [V] [TRT] Tactic: 2228223 time 3.62723
[08/16/2021-04:51:57] [V] [TRT] Tactic: 2424831 time 3.65334
[08/16/2021-04:51:57] [V] [TRT] Tactic: 2621439 time 3.83596
[08/16/2021-04:51:57] [V] [TRT] Tactic: 2752511 time 4.12845
[08/16/2021-04:51:58] [V] [TRT] Tactic: 2818047 time 4.01418
[08/16/2021-04:51:58] [V] [TRT] Tactic: 2883583 time 3.81378
[08/16/2021-04:51:58] [V] [TRT] Tactic: 3014655 time 3.47265
[08/16/2021-04:51:58] [V] [TRT] Tactic: 3145727 time 3.87476
[08/16/2021-04:51:58] [V] [TRT] Tactic: 3473407 time 3.94113
[08/16/2021-04:51:58] [V] [TRT] Tactic: 3604479 time 3.44864
[08/16/2021-04:51:59] [V] [TRT] Tactic: 3735551 time 7.76959
[08/16/2021-04:51:59] [V] [TRT] Tactic: 4390911 time 3.8217
[08/16/2021-04:51:59] [V] [TRT] Tactic: 5046271 time 4.94531
[08/16/2021-04:51:59] [V] [TRT] Tactic: 5963775 time 3.70266
[08/16/2021-04:52:00] [V] [TRT] Tactic: 6160383 time 4.41675
[08/16/2021-04:52:00] [V] [TRT] Tactic: 6488063 time 3.95508
[08/16/2021-04:52:00] [V] [TRT] Tactic: 6881279 time 4.04267
[08/16/2021-04:52:00] [V] [TRT] Tactic: 7274495 time 4.94208
[08/16/2021-04:52:00] [V] [TRT] Tactic: 7864319 time 4.20076
[08/16/2021-04:52:01] [V] [TRT] Tactic: 7995391 time 3.55728
[08/16/2021-04:52:01] [V] [TRT] Tactic: 8585215 time 4.50298
[08/16/2021-04:52:01] [V] [TRT] Tactic: 8847359 time 4.8136
[08/16/2021-04:52:01] [V] [TRT] Tactic: 8978431 time 3.7287
[08/16/2021-04:52:02] [V] [TRT] Tactic: 9043967 time 3.82005
[08/16/2021-04:52:02] [V] [TRT] Tactic: 9175039 time 3.45341
[08/16/2021-04:52:02] [V] [TRT] Tactic: 9502719 time 3.80087
[08/16/2021-04:52:02] [V] [TRT] Tactic: 9830399 time 5.10686
[08/16/2021-04:52:02] [V] [TRT] Tactic: 9961471 time 3.97522
[08/16/2021-04:52:03] [V] [TRT] Tactic: 10027007 time 4.76744
[08/16/2021-04:52:03] [V] [TRT] Tactic: 10092543 time 3.80893
[08/16/2021-04:52:03] [V] [TRT] Tactic: 10289151 time 3.31802
[08/16/2021-04:52:03] [V] [TRT] Tactic: 10485759 time 4.7872
[08/16/2021-04:52:03] [V] [TRT] Tactic: 10682367 time 3.72645
[08/16/2021-04:52:04] [V] [TRT] Tactic: 10813439 time 3.48612
[08/16/2021-04:52:04] [V] [TRT] Fastest Tactic: 1966079 Time: 3.30989
[08/16/2021-04:52:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:52:04] [V] [TRT] Tactic: 1145226902788474763 time 3.41088
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:52:04] [V] [TRT] Tactic: 2418518597804310654 time 3.24249
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:52:04] [V] [TRT] Tactic: 8292881859266835088 time 3.51632
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:52:04] [V] [TRT] Tactic: 8401509141903434922 time 3.15676
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:52:04] [V] [TRT] Tactic: -8654297089785671176 time 3.33199
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:52:04] [V] [TRT] Tactic: -7448936905981214224 time 3.57894
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:52:04] [V] [TRT] Tactic: -3689982367035295496 time 3.37466
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:52:04] [V] [TRT] Tactic: -2027588946874785071 time 3.46396
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:52:04] [V] [TRT] Tactic: -245090590808296743 time 3.43291
[08/16/2021-04:52:04] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 3.15676
[08/16/2021-04:52:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:52:04] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:52:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:52:04] [V] [TRT] 
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:52:04] [V] [TRT] *************** Autotuning format combination: Half(64,2048,1:8,65536) -> Float(1,32,1024,524288) ***************
[08/16/2021-04:52:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:52:04] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:52:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:52:04] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:52:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:04] [V] [TRT] *************** Autotuning format combination: Half(64,2048,1:8,65536) -> Half(64,2048,1:8,65536) ***************
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:52:04] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:04] [V] [TRT] Tactic: 3754069740140581927 time 1.01719
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:04] [V] [TRT] Tactic: 5925270497649423688 time 0.922868
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:04] [V] [TRT] Tactic: 6680916730816870145 time 1.07686
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:04] [V] [TRT] Tactic: 7158029511300006471 time 1.04237
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:04] [V] [TRT] Tactic: 7859952145590271433 time 1.0851
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:04] [V] [TRT] Tactic: 8283847742354150423 time 1.01048
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:04] [V] [TRT] Tactic: -4534876761957424274 time 0.957224
[08/16/2021-04:52:04] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:04] [V] [TRT] Tactic: -3237051169894153788 time 1.02164
[08/16/2021-04:52:04] [V] [TRT] Fastest Tactic: 5925270497649423688 Time: 0.922868
[08/16/2021-04:52:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:52:11] [V] [TRT] Tactic: 0 time 384.909
[08/16/2021-04:52:11] [V] [TRT] Tactic: 1 time 6.88497
[08/16/2021-04:52:11] [V] [TRT] Tactic: 2 time 9.07451
[08/16/2021-04:52:11] [V] [TRT] Tactic: 6 skipped. Scratch requested: 39848448, available: 16777216
[08/16/2021-04:52:11] [V] [TRT] Fastest Tactic: 1 Time: 6.88497
[08/16/2021-04:52:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:52:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5925270497649423688
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:11] [V] [TRT] 
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:11] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,2097152) ***************
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:52:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (FusedConvActConvolution)
[08/16/2021-04:52:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (CaskConvolution)
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:52:11] [V] [TRT] Tactic: 1754569683116234317 time 2.80094
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:52:11] [V] [TRT] Tactic: 1825138533642645384 time 2.81427
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:52:11] [V] [TRT] Tactic: 2733356012094739613 time 2.87626
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:52:11] [V] [TRT] Tactic: 3915320020053085238 time 2.80138
[08/16/2021-04:52:11] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:52:12] [V] [TRT] Tactic: 6808617066150061604 time 2.80218
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:52:12] [V] [TRT] Tactic: 9091006216302412844 time 2.75401
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:52:12] [V] [TRT] Tactic: -8060443123034038864 time 2.81036
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:52:12] [V] [TRT] Tactic: -4420849921117327522 time 3.27799
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:52:12] [V] [TRT] Tactic: -3946921629105938337 time 2.96824
[08/16/2021-04:52:12] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 2.75401
[08/16/2021-04:52:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (CudaConvolution)
[08/16/2021-04:52:12] [V] [TRT] Tactic: 0 time 4.39208
[08/16/2021-04:52:12] [V] [TRT] Tactic: 2 time 4.13428
[08/16/2021-04:52:12] [V] [TRT] Tactic: 5 skipped. Scratch requested: 153747456, available: 16777216
[08/16/2021-04:52:12] [V] [TRT] Tactic: 57 time 4.16136
[08/16/2021-04:52:12] [V] [TRT] Fastest Tactic: 2 Time: 4.13428
[08/16/2021-04:52:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[08/16/2021-04:52:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:52:12] [V] [TRT] 
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:52:12] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,524288) -> Half(1,32,1024,2097152) ***************
[08/16/2021-04:52:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (FusedConvActConvolution)
[08/16/2021-04:52:12] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (CaskConvolution)
[08/16/2021-04:52:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (CudaConvolution)
[08/16/2021-04:52:12] [V] [TRT] Tactic: 0 time 4.82387
[08/16/2021-04:52:12] [V] [TRT] Tactic: 1 time 4.42879
[08/16/2021-04:52:12] [V] [TRT] Tactic: 2 time 4.05433
[08/16/2021-04:52:12] [V] [TRT] Tactic: 4 skipped. Scratch requested: 9135456256, available: 16777216
[08/16/2021-04:52:12] [V] [TRT] Tactic: 5 skipped. Scratch requested: 153747456, available: 16777216
[08/16/2021-04:52:12] [V] [TRT] Fastest Tactic: 2 Time: 4.05433
[08/16/2021-04:52:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[08/16/2021-04:52:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2
[08/16/2021-04:52:12] [V] [TRT] 
[08/16/2021-04:52:12] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,262144) -> Half(1,32,1024:2,1048576) ***************
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:52:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (FusedConvActConvolution)
[08/16/2021-04:52:12] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (CaskConvolution)
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:52:12] [V] [TRT] Tactic: 2418518597804310654 time 1.41112
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:52:12] [V] [TRT] Tactic: 8292881859266835088 time 1.65559
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:52:12] [V] [TRT] Tactic: 8401509141903434922 time 1.38912
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:52:12] [V] [TRT] Tactic: -8654297089785671176 time 1.52367
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:52:12] [V] [TRT] Tactic: -7140760933967189247 time 1.37735
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:52:12] [V] [TRT] Tactic: -4097850214384059472 time 1.44147
[08/16/2021-04:52:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:52:13] [V] [TRT] Tactic: -3689982367035295496 time 1.52634
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:52:13] [V] [TRT] Tactic: -2534402059426524406 time 1.54014
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:52:13] [V] [TRT] Tactic: -2027588946874785071 time 1.54024
[08/16/2021-04:52:13] [V] [TRT] Fastest Tactic: -7140760933967189247 Time: 1.37735
[08/16/2021-04:52:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (CudaConvolution)
[08/16/2021-04:52:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[08/16/2021-04:52:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7140760933967189247
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:52:13] [V] [TRT] 
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:52:13] [V] [TRT] *************** Autotuning format combination: Half(64,2048,1:8,65536) -> Float(1,32,1024,2097152) ***************
[08/16/2021-04:52:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (FusedConvActConvolution)
[08/16/2021-04:52:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (CaskConvolution)
[08/16/2021-04:52:13] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (CudaConvolution)
[08/16/2021-04:52:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[08/16/2021-04:52:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:13] [V] [TRT] *************** Autotuning format combination: Half(64,2048,1:8,65536) -> Half(256,8192,1:8,262144) ***************
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (FusedConvActConvolution)
[08/16/2021-04:52:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (CaskConvolution)
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] Tactic: 2105695814191699972 time 0.594344
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] Tactic: 3754069740140581927 time 0.544648
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] Tactic: 5666160310350604399 time 0.543568
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] Tactic: 5925270497649423688 time 0.577004
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] Tactic: 6680916730816870145 time 0.709344
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] Tactic: 7158029511300006471 time 0.588428
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] Tactic: 7859952145590271433 time 0.699148
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] Tactic: 8283847742354150423 time 0.542244
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] Tactic: -8391760416076885205 time 0.574924
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] Tactic: -4534876761957424274 time 0.58418
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] Tactic: -3237051169894153788 time 0.58768
[08/16/2021-04:52:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:13] [V] [TRT] Tactic: -2422160065350346448 time 0.687276
[08/16/2021-04:52:13] [V] [TRT] Fastest Tactic: 8283847742354150423 Time: 0.542244
[08/16/2021-04:52:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (CudaConvolution)
[08/16/2021-04:52:21] [V] [TRT] Tactic: 0 time 530.403
[08/16/2021-04:52:21] [V] [TRT] Tactic: 1 time 4.63512
[08/16/2021-04:52:22] [V] [TRT] Tactic: 2 time 4.12644
[08/16/2021-04:52:22] [V] [TRT] Fastest Tactic: 2 Time: 4.12644
[08/16/2021-04:52:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[08/16/2021-04:52:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8283847742354150423
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:22] [V] [TRT] 
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:22] [V] [TRT] Tactic: 1002 time 0.464764
[08/16/2021-04:52:22] [V] [TRT] Tactic: 0 time 0.434684
[08/16/2021-04:52:22] [V] [TRT] Fastest Tactic: 0 Time: 0.434684
[08/16/2021-04:52:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:22] [V] [TRT] Tactic: 1002 time 0.750472
[08/16/2021-04:52:22] [V] [TRT] Tactic: 0 time 0.299812
[08/16/2021-04:52:22] [V] [TRT] Fastest Tactic: 0 Time: 0.299812
[08/16/2021-04:52:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:22] [V] [TRT] Tactic: 1002 time 0.556196
[08/16/2021-04:52:22] [V] [TRT] Tactic: 0 time 0.274424
[08/16/2021-04:52:22] [V] [TRT] Fastest Tactic: 0 Time: 0.274424
[08/16/2021-04:52:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:22] [V] [TRT] Tactic: 1002 time 0.517192
[08/16/2021-04:52:22] [V] [TRT] Tactic: 0 time 0.421956
[08/16/2021-04:52:22] [V] [TRT] Fastest Tactic: 0 Time: 0.421956
[08/16/2021-04:52:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:22] [V] [TRT] Tactic: 1002 time 0.749896
[08/16/2021-04:52:22] [V] [TRT] Tactic: 0 time 0.220872
[08/16/2021-04:52:22] [V] [TRT] Fastest Tactic: 0 Time: 0.220872
[08/16/2021-04:52:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:22] [V] [TRT] Tactic: 1002 time 0.558116
[08/16/2021-04:52:22] [V] [TRT] Tactic: 0 time 0.200348
[08/16/2021-04:52:22] [V] [TRT] Fastest Tactic: 0 Time: 0.200348
[08/16/2021-04:52:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:22] [V] [TRT] Tactic: 1002 time 0.988504
[08/16/2021-04:52:22] [V] [TRT] Tactic: 0 time 0.311176
[08/16/2021-04:52:22] [V] [TRT] Fastest Tactic: 0 Time: 0.311176
[08/16/2021-04:52:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:22] [V] [TRT] Tactic: 1002 time 0.960284
[08/16/2021-04:52:22] [V] [TRT] Tactic: 0 time 0.214548
[08/16/2021-04:52:22] [V] [TRT] Fastest Tactic: 0 Time: 0.214548
[08/16/2021-04:52:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:22] [V] [TRT] Tactic: 1002 time 0.554676
[08/16/2021-04:52:22] [V] [TRT] Tactic: 0 time 0.209984
[08/16/2021-04:52:22] [V] [TRT] Fastest Tactic: 0 Time: 0.209984
[08/16/2021-04:52:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:22] [V] [TRT] Tactic: 1002 time 0.570948
[08/16/2021-04:52:22] [V] [TRT] Tactic: 0 time 0.276804
[08/16/2021-04:52:22] [V] [TRT] Fastest Tactic: 0 Time: 0.276804
[08/16/2021-04:52:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:22] [V] [TRT] Tactic: 1002 time 0.56006
[08/16/2021-04:52:22] [V] [TRT] Tactic: 0 time 0.183512
[08/16/2021-04:52:22] [V] [TRT] Fastest Tactic: 0 Time: 0.183512
[08/16/2021-04:52:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:22] [V] [TRT] Tactic: 1002 time 0.83264
[08/16/2021-04:52:22] [V] [TRT] Tactic: 0 time 0.183464
[08/16/2021-04:52:22] [V] [TRT] Fastest Tactic: 0 Time: 0.183464
[08/16/2021-04:52:22] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,4194304), Float(1,32,1024,2097152) -> Float(1,32,1024,2097152) ***************
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:52:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (CaskConvolution)
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:52:22] [V] [TRT] Tactic: 1754569683116234317 time 5.52674
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:52:22] [V] [TRT] Tactic: 1825138533642645384 time 5.55901
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:52:22] [V] [TRT] Tactic: 2733356012094739613 time 8.75774
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:52:22] [V] [TRT] Tactic: 3915320020053085238 time 6.41562
[08/16/2021-04:52:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:52:23] [V] [TRT] Tactic: 6808617066150061604 time 6.50969
[08/16/2021-04:52:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:52:23] [V] [TRT] Tactic: 9091006216302412844 time 6.00686
[08/16/2021-04:52:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:52:23] [V] [TRT] Tactic: -8060443123034038864 time 6.09365
[08/16/2021-04:52:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:52:23] [V] [TRT] Tactic: -4420849921117327522 time 6.83803
[08/16/2021-04:52:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:52:23] [V] [TRT] Tactic: -3946921629105938337 time 10.1004
[08/16/2021-04:52:23] [V] [TRT] Fastest Tactic: 1754569683116234317 Time: 5.52674
[08/16/2021-04:52:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (CudaConvolution)
[08/16/2021-04:52:23] [V] [TRT] Tactic: 0 time 8.12562
[08/16/2021-04:52:23] [V] [TRT] Tactic: 2 time 7.45045
[08/16/2021-04:52:24] [V] [TRT] Tactic: 57 time 7.22656
[08/16/2021-04:52:24] [V] [TRT] Fastest Tactic: 57 Time: 7.22656
[08/16/2021-04:52:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1754569683116234317
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:52:24] [V] [TRT] 
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:52:24] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,4194304), Half(1,32,1024,2097152) -> Half(1,32,1024,2097152) ***************
[08/16/2021-04:52:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (CaskConvolution)
[08/16/2021-04:52:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (CudaConvolution)
[08/16/2021-04:52:24] [V] [TRT] Tactic: 0 time 8.35398
[08/16/2021-04:52:24] [V] [TRT] Tactic: 1 time 6.54314
[08/16/2021-04:52:24] [V] [TRT] Tactic: 2 time 6.89822
[08/16/2021-04:52:24] [V] [TRT] Fastest Tactic: 1 Time: 6.54314
[08/16/2021-04:52:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:52:24] [V] [TRT] 
[08/16/2021-04:52:24] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,2097152), Half(1,32,1024:2,1048576) -> Half(1,32,1024:2,1048576) ***************
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:52:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (CaskConvolution)
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:52:24] [V] [TRT] Tactic: 2418518597804310654 time 2.92806
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:52:24] [V] [TRT] Tactic: 8292881859266835088 time 5.01736
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:52:24] [V] [TRT] Tactic: 8401509141903434922 time 2.91313
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:52:24] [V] [TRT] Tactic: -8654297089785671176 time 2.9205
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:52:24] [V] [TRT] Tactic: -7140760933967189247 time 3.08086
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:52:24] [V] [TRT] Tactic: -4097850214384059472 time 4.56572
[08/16/2021-04:52:24] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:52:25] [V] [TRT] Tactic: -3689982367035295496 time 2.90662
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:52:25] [V] [TRT] Tactic: -2534402059426524406 time 2.8012
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:52:25] [V] [TRT] Tactic: -2027588946874785071 time 5.11454
[08/16/2021-04:52:25] [V] [TRT] Fastest Tactic: -2534402059426524406 Time: 2.8012
[08/16/2021-04:52:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (CudaConvolution)
[08/16/2021-04:52:25] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2534402059426524406
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:52:25] [V] [TRT] 
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:52:25] [V] [TRT] *************** Autotuning format combination: Half(128,8192,1:8,524288), Float(1,32,1024,2097152) -> Float(1,32,1024,2097152) ***************
[08/16/2021-04:52:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (CaskConvolution)
[08/16/2021-04:52:25] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (CudaConvolution)
[08/16/2021-04:52:25] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:25] [V] [TRT] *************** Autotuning format combination: Half(128,8192,1:8,524288), Half(256,8192,1:8,262144) -> Half(256,8192,1:8,262144) ***************
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (CaskConvolution)
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] Tactic: 2105695814191699972 time 1.12346
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] Tactic: 3754069740140581927 time 1.01983
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] Tactic: 5666160310350604399 time 1.02101
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] Tactic: 5925270497649423688 time 0.984624
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] Tactic: 6680916730816870145 time 1.21453
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] Tactic: 7158029511300006471 time 1.11107
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] Tactic: 7859952145590271433 time 1.2082
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] Tactic: 8283847742354150423 time 1.01471
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] Tactic: -8391760416076885205 time 1.01312
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] Tactic: -4534876761957424274 time 1.0008
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] Tactic: -3237051169894153788 time 1.12349
[08/16/2021-04:52:25] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:25] [V] [TRT] Tactic: -2422160065350346448 time 1.18006
[08/16/2021-04:52:25] [V] [TRT] Fastest Tactic: 5925270497649423688 Time: 0.984624
[08/16/2021-04:52:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (CudaConvolution)
[08/16/2021-04:52:25] [V] [TRT] Tactic: 0 time 8.86632
[08/16/2021-04:52:25] [V] [TRT] Tactic: 1 time 10.2236
[08/16/2021-04:52:26] [V] [TRT] Tactic: 2 time 7.14705
[08/16/2021-04:52:26] [V] [TRT] Fastest Tactic: 2 Time: 7.14705
[08/16/2021-04:52:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5925270497649423688
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:26] [V] [TRT] 
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:52:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:26] [V] [TRT] Tactic: 1002 time 0.441328
[08/16/2021-04:52:26] [V] [TRT] Tactic: 0 time 0.43342
[08/16/2021-04:52:26] [V] [TRT] Fastest Tactic: 0 Time: 0.43342
[08/16/2021-04:52:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:26] [V] [TRT] Tactic: 1002 time 0.749368
[08/16/2021-04:52:26] [V] [TRT] Tactic: 0 time 0.274836
[08/16/2021-04:52:26] [V] [TRT] Fastest Tactic: 0 Time: 0.274836
[08/16/2021-04:52:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:26] [V] [TRT] Tactic: 1002 time 0.554204
[08/16/2021-04:52:26] [V] [TRT] Tactic: 0 time 0.273264
[08/16/2021-04:52:26] [V] [TRT] Fastest Tactic: 0 Time: 0.273264
[08/16/2021-04:52:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:26] [V] [TRT] Tactic: 1002 time 0.51556
[08/16/2021-04:52:26] [V] [TRT] Tactic: 0 time 0.422028
[08/16/2021-04:52:26] [V] [TRT] Fastest Tactic: 0 Time: 0.422028
[08/16/2021-04:52:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:26] [V] [TRT] Tactic: 1002 time 0.746716
[08/16/2021-04:52:26] [V] [TRT] Tactic: 0 time 0.220752
[08/16/2021-04:52:26] [V] [TRT] Fastest Tactic: 0 Time: 0.220752
[08/16/2021-04:52:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:26] [V] [TRT] Tactic: 1002 time 0.561664
[08/16/2021-04:52:26] [V] [TRT] Tactic: 0 time 0.200612
[08/16/2021-04:52:26] [V] [TRT] Fastest Tactic: 0 Time: 0.200612
[08/16/2021-04:52:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:26] [V] [TRT] Tactic: 1002 time 0.967972
[08/16/2021-04:52:26] [V] [TRT] Tactic: 0 time 0.31194
[08/16/2021-04:52:26] [V] [TRT] Fastest Tactic: 0 Time: 0.31194
[08/16/2021-04:52:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:26] [V] [TRT] Tactic: 1002 time 0.960592
[08/16/2021-04:52:26] [V] [TRT] Tactic: 0 time 0.213856
[08/16/2021-04:52:26] [V] [TRT] Fastest Tactic: 0 Time: 0.213856
[08/16/2021-04:52:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:26] [V] [TRT] Tactic: 1002 time 0.555856
[08/16/2021-04:52:26] [V] [TRT] Tactic: 0 time 0.209248
[08/16/2021-04:52:26] [V] [TRT] Fastest Tactic: 0 Time: 0.209248
[08/16/2021-04:52:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:26] [V] [TRT] Tactic: 1002 time 0.569744
[08/16/2021-04:52:26] [V] [TRT] Tactic: 0 time 0.27958
[08/16/2021-04:52:26] [V] [TRT] Fastest Tactic: 0 Time: 0.27958
[08/16/2021-04:52:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:26] [V] [TRT] Tactic: 1002 time 0.55946
[08/16/2021-04:52:26] [V] [TRT] Tactic: 0 time 0.18362
[08/16/2021-04:52:26] [V] [TRT] Fastest Tactic: 0 Time: 0.18362
[08/16/2021-04:52:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:52:26] [V] [TRT] Tactic: 1002 time 0.830964
[08/16/2021-04:52:26] [V] [TRT] Tactic: 0 time 0.185664
[08/16/2021-04:52:26] [V] [TRT] Fastest Tactic: 0 Time: 0.185664
[08/16/2021-04:52:26] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,2097152) -> Float(1,32,1024,524288) ***************
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:52:26] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:52:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:52:26] [V] [TRT] Tactic: 589823 time 6.23024
[08/16/2021-04:52:26] [V] [TRT] Tactic: 655359 time 4.04102
[08/16/2021-04:52:27] [V] [TRT] Tactic: 786431 time 7.30789
[08/16/2021-04:52:27] [V] [TRT] Tactic: 851967 time 5.05981
[08/16/2021-04:52:27] [V] [TRT] Tactic: 1179647 time 5.11302
[08/16/2021-04:52:28] [V] [TRT] Tactic: 1310719 time 16.4081
[08/16/2021-04:52:28] [V] [TRT] Tactic: 1376255 time 4.24542
[08/16/2021-04:52:29] [V] [TRT] Tactic: 1441791 time 8.705
[08/16/2021-04:52:29] [V] [TRT] Tactic: 1507327 time 5.11124
[08/16/2021-04:52:29] [V] [TRT] Tactic: 1638399 time 6.56162
[08/16/2021-04:52:29] [V] [TRT] Tactic: 1835007 time 8.69315
[08/16/2021-04:52:30] [V] [TRT] Tactic: 1900543 time 5.08218
[08/16/2021-04:52:30] [V] [TRT] Tactic: 2097151 time 5.54408
[08/16/2021-04:52:30] [V] [TRT] Tactic: 2162687 time 4.65813
[08/16/2021-04:52:30] [V] [TRT] Tactic: 2293759 time 4.8092
[08/16/2021-04:52:31] [V] [TRT] Tactic: 2359295 time 4.85151
[08/16/2021-04:52:31] [V] [TRT] Tactic: 2686975 time 4.62281
[08/16/2021-04:52:31] [V] [TRT] Tactic: 3080191 time 4.81515
[08/16/2021-04:52:31] [V] [TRT] Tactic: 3342335 time 5.15171
[08/16/2021-04:52:32] [V] [TRT] Tactic: 3407871 time 5.31878
[08/16/2021-04:52:32] [V] [TRT] Tactic: 3538943 time 4.6993
[08/16/2021-04:52:32] [V] [TRT] Tactic: 3670015 time 5.7853
[08/16/2021-04:52:32] [V] [TRT] Tactic: 3932159 time 5.19274
[08/16/2021-04:52:33] [V] [TRT] Tactic: 3997695 time 6.09837
[08/16/2021-04:52:33] [V] [TRT] Tactic: 4063231 time 5.05627
[08/16/2021-04:52:33] [V] [TRT] Tactic: 4194303 time 5.27458
[08/16/2021-04:52:33] [V] [TRT] Tactic: 4259839 time 4.57045
[08/16/2021-04:52:34] [V] [TRT] Tactic: 4325375 time 5.96999
[08/16/2021-04:52:34] [V] [TRT] Tactic: 4521983 time 5.25651
[08/16/2021-04:52:34] [V] [TRT] Tactic: 4587519 time 5.73121
[08/16/2021-04:52:34] [V] [TRT] Tactic: 4653055 time 4.76026
[08/16/2021-04:52:35] [V] [TRT] Tactic: 4915199 time 5.23259
[08/16/2021-04:52:35] [V] [TRT] Tactic: 4980735 time 5.62083
[08/16/2021-04:52:35] [V] [TRT] Tactic: 5177343 time 6.08025
[08/16/2021-04:52:35] [V] [TRT] Tactic: 5242879 time 5.67907
[08/16/2021-04:52:36] [V] [TRT] Tactic: 5373951 time 11.7941
[08/16/2021-04:52:37] [V] [TRT] Tactic: 5439487 time 22.0686
[08/16/2021-04:52:37] [V] [TRT] Tactic: 5570559 time 4.59661
[08/16/2021-04:52:37] [V] [TRT] Tactic: 5636095 time 5.05926
[08/16/2021-04:52:38] [V] [TRT] Tactic: 5701631 time 4.7437
[08/16/2021-04:52:40] [V] [TRT] Tactic: 5767167 time 62.391
[08/16/2021-04:52:40] [V] [TRT] Tactic: 5832703 time 4.8978
[08/16/2021-04:52:41] [V] [TRT] Tactic: 5898239 time 4.80541
[08/16/2021-04:52:41] [V] [TRT] Tactic: 6029311 time 4.38555
[08/16/2021-04:52:41] [V] [TRT] Tactic: 6225919 time 5.54772
[08/16/2021-04:52:41] [V] [TRT] Tactic: 6291455 time 5.09076
[08/16/2021-04:52:42] [V] [TRT] Tactic: 6422527 time 4.23918
[08/16/2021-04:52:42] [V] [TRT] Tactic: 6750207 time 11.1377
[08/16/2021-04:52:43] [V] [TRT] Tactic: 6815743 time 11.4184
[08/16/2021-04:52:43] [V] [TRT] Tactic: 6946815 time 17.6987
[08/16/2021-04:52:44] [V] [TRT] Tactic: 7012351 time 5.55245
[08/16/2021-04:52:44] [V] [TRT] Tactic: 7077887 time 4.66794
[08/16/2021-04:52:45] [V] [TRT] Tactic: 7143423 time 24.8556
[08/16/2021-04:52:45] [V] [TRT] Tactic: 7208959 time 5.25099
[08/16/2021-04:52:45] [V] [TRT] Tactic: 7340031 time 5.09617
[08/16/2021-04:52:46] [V] [TRT] Tactic: 7405567 time 4.72885
[08/16/2021-04:52:46] [V] [TRT] Tactic: 7536639 time 5.91679
[08/16/2021-04:52:46] [V] [TRT] Tactic: 7602175 time 6.36745
[08/16/2021-04:52:46] [V] [TRT] Tactic: 7733247 time 4.82017
[08/16/2021-04:52:47] [V] [TRT] Tactic: 7798783 time 7.35682
[08/16/2021-04:52:48] [V] [TRT] Tactic: 8191999 time 18.807
[08/16/2021-04:52:48] [V] [TRT] Tactic: 8257535 time 5.32626
[08/16/2021-04:52:48] [V] [TRT] Tactic: 8323071 time 10.0222
[08/16/2021-04:52:49] [V] [TRT] Tactic: 8650751 time 9.17294
[08/16/2021-04:52:49] [V] [TRT] Tactic: 8716287 time 13.2524
[08/16/2021-04:52:49] [V] [TRT] Tactic: 9109503 time 5.7311
[08/16/2021-04:52:50] [V] [TRT] Tactic: 9568255 time 5.1917
[08/16/2021-04:52:50] [V] [TRT] Tactic: 9895935 time 5.27525
[08/16/2021-04:52:50] [V] [TRT] Tactic: 10223615 time 4.65718
[08/16/2021-04:52:50] [V] [TRT] Tactic: 10354687 time 4.60694
[08/16/2021-04:52:51] [V] [TRT] Tactic: 10551295 time 6.51122
[08/16/2021-04:52:51] [V] [TRT] Tactic: 10747903 time 4.53016
[08/16/2021-04:52:51] [V] [TRT] Tactic: 10944511 time 5.61248
[08/16/2021-04:52:51] [V] [TRT] Fastest Tactic: 655359 Time: 4.04102
[08/16/2021-04:52:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:52:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:52:51] [V] [TRT] Tactic: 1754569683116234317 time 2.90585
[08/16/2021-04:52:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:52:51] [V] [TRT] Tactic: 1825138533642645384 time 2.9155
[08/16/2021-04:52:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:52:51] [V] [TRT] Tactic: 2733356012094739613 time 3.12648
[08/16/2021-04:52:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:52:51] [V] [TRT] Tactic: 3915320020053085238 time 2.90402
[08/16/2021-04:52:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:52:52] [V] [TRT] Tactic: 6808617066150061604 time 2.73612
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:52:52] [V] [TRT] Tactic: 9091006216302412844 time 2.65519
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:52:52] [V] [TRT] Tactic: -8060443123034038864 time 2.75772
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:52:52] [V] [TRT] Tactic: -4420849921117327522 time 3.35316
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:52:52] [V] [TRT] Tactic: -3946921629105938337 time 3.15196
[08/16/2021-04:52:52] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 2.65519
[08/16/2021-04:52:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:52:52] [V] [TRT] Tactic: 0 time 4.37906
[08/16/2021-04:52:52] [V] [TRT] Tactic: 2 time 4.49368
[08/16/2021-04:52:52] [V] [TRT] Tactic: 5 skipped. Scratch requested: 153747456, available: 16777216
[08/16/2021-04:52:52] [V] [TRT] Tactic: 57 time 3.92553
[08/16/2021-04:52:52] [V] [TRT] Fastest Tactic: 57 Time: 3.92553
[08/16/2021-04:52:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:52:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:52:52] [V] [TRT] 
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:52:52] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,2097152) -> Half(1,32,1024,524288) ***************
[08/16/2021-04:52:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:52:52] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:52:52] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:52:52] [V] [TRT] Tactic: 0 time 4.50152
[08/16/2021-04:52:52] [V] [TRT] Tactic: 1 time 4.49338
[08/16/2021-04:52:52] [V] [TRT] Tactic: 2 time 3.99918
[08/16/2021-04:52:52] [V] [TRT] Tactic: 4 skipped. Scratch requested: 9148825600, available: 16777216
[08/16/2021-04:52:52] [V] [TRT] Tactic: 5 skipped. Scratch requested: 153747456, available: 16777216
[08/16/2021-04:52:52] [V] [TRT] Fastest Tactic: 2 Time: 3.99918
[08/16/2021-04:52:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:52:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:52:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2
[08/16/2021-04:52:52] [V] [TRT] 
[08/16/2021-04:52:52] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,1048576) -> Half(1,32,1024:2,262144) ***************
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:52:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:52:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:52:52] [V] [TRT] Tactic: 589823 time 3.17603
[08/16/2021-04:52:53] [V] [TRT] Tactic: 655359 time 2.03846
[08/16/2021-04:52:53] [V] [TRT] Tactic: 786431 time 2.99898
[08/16/2021-04:52:53] [V] [TRT] Tactic: 851967 time 2.5685
[08/16/2021-04:52:53] [V] [TRT] Tactic: 1179647 time 2.96889
[08/16/2021-04:52:54] [V] [TRT] Tactic: 1310719 time 15.4697
[08/16/2021-04:52:54] [V] [TRT] Tactic: 1376255 time 1.73817
[08/16/2021-04:52:54] [V] [TRT] Tactic: 1441791 time 4.2112
[08/16/2021-04:52:54] [V] [TRT] Tactic: 1507327 time 2.57102
[08/16/2021-04:52:54] [V] [TRT] Tactic: 1638399 time 3.43654
[08/16/2021-04:52:54] [V] [TRT] Tactic: 1835007 time 3.39899
[08/16/2021-04:52:55] [V] [TRT] Tactic: 1900543 time 3.00927
[08/16/2021-04:52:55] [V] [TRT] Tactic: 2097151 time 3.14144
[08/16/2021-04:52:55] [V] [TRT] Tactic: 2162687 time 2.20216
[08/16/2021-04:52:55] [V] [TRT] Tactic: 2293759 time 2.29892
[08/16/2021-04:52:55] [V] [TRT] Tactic: 2359295 time 2.2241
[08/16/2021-04:52:55] [V] [TRT] Tactic: 2686975 time 2.35981
[08/16/2021-04:52:55] [V] [TRT] Tactic: 3080191 time 2.423
[08/16/2021-04:52:56] [V] [TRT] Tactic: 3342335 time 2.59234
[08/16/2021-04:52:56] [V] [TRT] Tactic: 3407871 time 2.15348
[08/16/2021-04:52:56] [V] [TRT] Tactic: 3538943 time 2.61181
[08/16/2021-04:52:56] [V] [TRT] Tactic: 3670015 time 2.90576
[08/16/2021-04:52:56] [V] [TRT] Tactic: 3932159 time 2.5799
[08/16/2021-04:52:56] [V] [TRT] Tactic: 3997695 time 3.48367
[08/16/2021-04:52:56] [V] [TRT] Tactic: 4063231 time 2.56289
[08/16/2021-04:52:57] [V] [TRT] Tactic: 4194303 time 2.64601
[08/16/2021-04:52:57] [V] [TRT] Tactic: 4259839 time 2.41726
[08/16/2021-04:52:57] [V] [TRT] Tactic: 4325375 time 3.13505
[08/16/2021-04:52:57] [V] [TRT] Tactic: 4521983 time 2.55516
[08/16/2021-04:52:57] [V] [TRT] Tactic: 4587519 time 2.96611
[08/16/2021-04:52:57] [V] [TRT] Tactic: 4653055 time 2.5116
[08/16/2021-04:52:58] [V] [TRT] Tactic: 4915199 time 2.95677
[08/16/2021-04:52:58] [V] [TRT] Tactic: 4980735 time 2.95772
[08/16/2021-04:52:58] [V] [TRT] Tactic: 5177343 time 3.08121
[08/16/2021-04:52:58] [V] [TRT] Tactic: 5242879 time 2.16801
[08/16/2021-04:52:58] [V] [TRT] Tactic: 5373951 time 4.85072
[08/16/2021-04:52:59] [V] [TRT] Tactic: 5439487 time 8.44309
[08/16/2021-04:52:59] [V] [TRT] Tactic: 5570559 time 2.31176
[08/16/2021-04:52:59] [V] [TRT] Tactic: 5636095 time 2.56233
[08/16/2021-04:52:59] [V] [TRT] Tactic: 5701631 time 2.35034
[08/16/2021-04:53:00] [V] [TRT] Tactic: 5767167 time 26.5922
[08/16/2021-04:53:00] [V] [TRT] Tactic: 5832703 time 2.02755
[08/16/2021-04:53:00] [V] [TRT] Tactic: 5898239 time 2.36032
[08/16/2021-04:53:00] [V] [TRT] Tactic: 6029311 time 2.27091
[08/16/2021-04:53:00] [V] [TRT] Tactic: 6225919 time 2.84298
[08/16/2021-04:53:01] [V] [TRT] Tactic: 6291455 time 2.94948
[08/16/2021-04:53:01] [V] [TRT] Tactic: 6422527 time 2.12605
[08/16/2021-04:53:01] [V] [TRT] Tactic: 6750207 time 5.29496
[08/16/2021-04:53:01] [V] [TRT] Tactic: 6815743 time 4.35462
[08/16/2021-04:53:01] [V] [TRT] Tactic: 6946815 time 5.92474
[08/16/2021-04:53:02] [V] [TRT] Tactic: 7012351 time 3.15054
[08/16/2021-04:53:02] [V] [TRT] Tactic: 7077887 time 2.55399
[08/16/2021-04:53:02] [V] [TRT] Tactic: 7143423 time 8.74596
[08/16/2021-04:53:02] [V] [TRT] Tactic: 7208959 time 2.08602
[08/16/2021-04:53:02] [V] [TRT] Tactic: 7340031 time 2.49649
[08/16/2021-04:53:03] [V] [TRT] Tactic: 7405567 time 2.6062
[08/16/2021-04:53:03] [V] [TRT] Tactic: 7536639 time 2.97203
[08/16/2021-04:53:03] [V] [TRT] Tactic: 7602175 time 3.31427
[08/16/2021-04:53:03] [V] [TRT] Tactic: 7733247 time 2.12288
[08/16/2021-04:53:03] [V] [TRT] Tactic: 7798783 time 3.00699
[08/16/2021-04:53:03] [V] [TRT] Tactic: 8191999 time 8.23062
[08/16/2021-04:53:04] [V] [TRT] Tactic: 8257535 time 2.94192
[08/16/2021-04:53:04] [V] [TRT] Tactic: 8323071 time 3.89074
[08/16/2021-04:53:04] [V] [TRT] Tactic: 8650751 time 3.45466
[08/16/2021-04:53:04] [V] [TRT] Tactic: 8716287 time 5.56942
[08/16/2021-04:53:04] [V] [TRT] Tactic: 9109503 time 3.21796
[08/16/2021-04:53:05] [V] [TRT] Tactic: 9568255 time 2.87704
[08/16/2021-04:53:05] [V] [TRT] Tactic: 9895935 time 2.70231
[08/16/2021-04:53:05] [V] [TRT] Tactic: 10223615 time 2.35922
[08/16/2021-04:53:05] [V] [TRT] Tactic: 10354687 time 2.32787
[08/16/2021-04:53:05] [V] [TRT] Tactic: 10551295 time 2.95144
[08/16/2021-04:53:05] [V] [TRT] Tactic: 10747903 time 2.06139
[08/16/2021-04:53:05] [V] [TRT] Tactic: 10944511 time 2.93473
[08/16/2021-04:53:05] [V] [TRT] Fastest Tactic: 1376255 Time: 1.73817
[08/16/2021-04:53:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:53:05] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:53:05] [V] [TRT] Tactic: 2418518597804310654 time 1.42435
[08/16/2021-04:53:05] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:53:05] [V] [TRT] Tactic: 8292881859266835088 time 1.61363
[08/16/2021-04:53:05] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:53:05] [V] [TRT] Tactic: 8401509141903434922 time 1.40478
[08/16/2021-04:53:05] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:53:05] [V] [TRT] Tactic: -8654297089785671176 time 1.51232
[08/16/2021-04:53:05] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:53:05] [V] [TRT] Tactic: -7140760933967189247 time 1.36782
[08/16/2021-04:53:05] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:53:06] [V] [TRT] Tactic: -4097850214384059472 time 1.56272
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:53:06] [V] [TRT] Tactic: -3689982367035295496 time 1.51117
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:53:06] [V] [TRT] Tactic: -2534402059426524406 time 1.4689
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:53:06] [V] [TRT] Tactic: -2027588946874785071 time 1.72825
[08/16/2021-04:53:06] [V] [TRT] Fastest Tactic: -7140760933967189247 Time: 1.36782
[08/16/2021-04:53:06] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:53:06] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:06] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:53:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7140760933967189247
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:53:06] [V] [TRT] 
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:53:06] [V] [TRT] *************** Autotuning format combination: Half(256,8192,1:8,262144) -> Float(1,32,1024,524288) ***************
[08/16/2021-04:53:06] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:53:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:06] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:53:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:06] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:53:06] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:06] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:53:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:06] [V] [TRT] *************** Autotuning format combination: Half(256,8192,1:8,262144) -> Half(64,2048,1:8,65536) ***************
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:53:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:06] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] Tactic: 2105695814191699972 time 0.541668
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] Tactic: 3754069740140581927 time 0.493116
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] Tactic: 5666160310350604399 time 0.490668
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] Tactic: 5925270497649423688 time 0.4848
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] Tactic: 6680916730816870145 time 0.569568
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] Tactic: 7158029511300006471 time 0.532204
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] Tactic: 7859952145590271433 time 0.56482
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] Tactic: 8283847742354150423 time 0.487224
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] Tactic: -8391760416076885205 time 0.488092
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] Tactic: -4534876761957424274 time 0.5028
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] Tactic: -3237051169894153788 time 0.529296
[08/16/2021-04:53:06] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:06] [V] [TRT] Tactic: -2422160065350346448 time 0.547804
[08/16/2021-04:53:06] [V] [TRT] Fastest Tactic: 5925270497649423688 Time: 0.4848
[08/16/2021-04:53:06] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:53:20] [V] [TRT] Tactic: 0 time 842.597
[08/16/2021-04:53:20] [V] [TRT] Tactic: 1 time 4.77023
[08/16/2021-04:53:20] [V] [TRT] Tactic: 2 time 5.89351
[08/16/2021-04:53:20] [V] [TRT] Fastest Tactic: 1 Time: 4.77023
[08/16/2021-04:53:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:53:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5925270497649423688
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:20] [V] [TRT] 
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:20] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,524288) ***************
[08/16/2021-04:53:20] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,524288) -> Half(1,32,1024,524288) ***************
[08/16/2021-04:53:20] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,262144) -> Half(1,32,1024:2,262144) ***************
[08/16/2021-04:53:20] [V] [TRT] *************** Autotuning format combination: Half(64,2048,1:8,65536) -> Float(1,32,1024,524288) ***************
[08/16/2021-04:53:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:53:20] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:53:20] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:53:20] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:53:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:20] [V] [TRT] *************** Autotuning format combination: Half(64,2048,1:8,65536) -> Half(64,2048,1:8,65536) ***************
[08/16/2021-04:53:20] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288), Float(1,32,1024,2097152) -> Float(1,32,1024,2097152) ***************
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:53:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (CaskConvolution)
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:53:20] [V] [TRT] Tactic: 1754569683116234317 time 2.9344
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:53:20] [V] [TRT] Tactic: 1825138533642645384 time 2.94684
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:53:20] [V] [TRT] Tactic: 2733356012094739613 time 3.0503
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:53:20] [V] [TRT] Tactic: 3915320020053085238 time 2.93603
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:53:20] [V] [TRT] Tactic: 6808617066150061604 time 2.93734
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:53:20] [V] [TRT] Tactic: 9091006216302412844 time 2.88165
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:53:20] [V] [TRT] Tactic: -8060443123034038864 time 2.97384
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:53:20] [V] [TRT] Tactic: -4420849921117327522 time 3.39357
[08/16/2021-04:53:20] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:53:20] [V] [TRT] Tactic: -3946921629105938337 time 3.08318
[08/16/2021-04:53:20] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 2.88165
[08/16/2021-04:53:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (CudaConvolution)
[08/16/2021-04:53:21] [V] [TRT] Tactic: 0 time 5.34044
[08/16/2021-04:53:21] [V] [TRT] Tactic: 2 time 4.97764
[08/16/2021-04:53:21] [V] [TRT] Tactic: 5 skipped. Scratch requested: 153747456, available: 16777216
[08/16/2021-04:53:21] [V] [TRT] Tactic: 57 time 5.06121
[08/16/2021-04:53:21] [V] [TRT] Fastest Tactic: 2 Time: 4.97764
[08/16/2021-04:53:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:53:21] [V] [TRT] 
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:53:21] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,524288), Half(1,32,1024,2097152) -> Half(1,32,1024,2097152) ***************
[08/16/2021-04:53:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (CaskConvolution)
[08/16/2021-04:53:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (CudaConvolution)
[08/16/2021-04:53:21] [V] [TRT] Tactic: 0 time 5.1551
[08/16/2021-04:53:21] [V] [TRT] Tactic: 1 time 4.93966
[08/16/2021-04:53:21] [V] [TRT] Tactic: 2 time 4.51447
[08/16/2021-04:53:21] [V] [TRT] Tactic: 4 skipped. Scratch requested: 9135456256, available: 16777216
[08/16/2021-04:53:21] [V] [TRT] Tactic: 5 skipped. Scratch requested: 153747456, available: 16777216
[08/16/2021-04:53:21] [V] [TRT] Fastest Tactic: 2 Time: 4.51447
[08/16/2021-04:53:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2
[08/16/2021-04:53:21] [V] [TRT] 
[08/16/2021-04:53:21] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,262144), Half(1,32,1024:2,1048576) -> Half(1,32,1024:2,1048576) ***************
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:53:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (CaskConvolution)
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:53:21] [V] [TRT] Tactic: 2418518597804310654 time 1.44068
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:53:21] [V] [TRT] Tactic: 8292881859266835088 time 1.61073
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:53:21] [V] [TRT] Tactic: 8401509141903434922 time 1.4106
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:53:21] [V] [TRT] Tactic: -8654297089785671176 time 1.55797
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:53:21] [V] [TRT] Tactic: -7140760933967189247 time 1.40909
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:53:21] [V] [TRT] Tactic: -4097850214384059472 time 1.46361
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:53:21] [V] [TRT] Tactic: -3689982367035295496 time 1.56383
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:53:21] [V] [TRT] Tactic: -2534402059426524406 time 1.47553
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:53:21] [V] [TRT] Tactic: -2027588946874785071 time 1.61718
[08/16/2021-04:53:21] [V] [TRT] Fastest Tactic: -7140760933967189247 Time: 1.40909
[08/16/2021-04:53:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (CudaConvolution)
[08/16/2021-04:53:21] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7140760933967189247
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:53:21] [V] [TRT] 
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:53:21] [V] [TRT] *************** Autotuning format combination: Half(64,2048,1:8,65536), Float(1,32,1024,2097152) -> Float(1,32,1024,2097152) ***************
[08/16/2021-04:53:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (CaskConvolution)
[08/16/2021-04:53:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (CudaConvolution)
[08/16/2021-04:53:21] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:21] [V] [TRT] *************** Autotuning format combination: Half(64,2048,1:8,65536), Half(256,8192,1:8,262144) -> Half(256,8192,1:8,262144) ***************
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (CaskConvolution)
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:21] [V] [TRT] Tactic: 2105695814191699972 time 0.654212
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:21] [V] [TRT] Tactic: 3754069740140581927 time 0.60088
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:21] [V] [TRT] Tactic: 5666160310350604399 time 0.600944
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:21] [V] [TRT] Tactic: 5925270497649423688 time 0.600532
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:21] [V] [TRT] Tactic: 6680916730816870145 time 0.784024
[08/16/2021-04:53:21] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:22] [V] [TRT] Tactic: 7158029511300006471 time 0.65306
[08/16/2021-04:53:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:22] [V] [TRT] Tactic: 7859952145590271433 time 0.7782
[08/16/2021-04:53:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:22] [V] [TRT] Tactic: 8283847742354150423 time 0.60676
[08/16/2021-04:53:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:22] [V] [TRT] Tactic: -8391760416076885205 time 0.608916
[08/16/2021-04:53:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:22] [V] [TRT] Tactic: -4534876761957424274 time 0.610788
[08/16/2021-04:53:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:22] [V] [TRT] Tactic: -3237051169894153788 time 0.677652
[08/16/2021-04:53:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:22] [V] [TRT] Tactic: -2422160065350346448 time 0.770276
[08/16/2021-04:53:22] [V] [TRT] Fastest Tactic: 5925270497649423688 Time: 0.600532
[08/16/2021-04:53:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (CudaConvolution)
[08/16/2021-04:53:30] [V] [TRT] Tactic: 0 time 525.374
[08/16/2021-04:53:30] [V] [TRT] Tactic: 1 time 5.17055
[08/16/2021-04:53:30] [V] [TRT] Tactic: 2 time 4.6374
[08/16/2021-04:53:30] [V] [TRT] Fastest Tactic: 2 Time: 4.6374
[08/16/2021-04:53:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5925270497649423688
[08/16/2021-04:53:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:30] [V] [TRT] 
[08/16/2021-04:53:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:30] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:30] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,2097152) -> Float(1,32,1024,524288) ***************
[08/16/2021-04:53:30] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,2097152) -> Half(1,32,1024,524288) ***************
[08/16/2021-04:53:30] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,1048576) -> Half(1,32,1024:2,262144) ***************
[08/16/2021-04:53:30] [V] [TRT] *************** Autotuning format combination: Half(256,8192,1:8,262144) -> Float(1,32,1024,524288) ***************
[08/16/2021-04:53:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:53:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_relu/Relu6 (CaskConvolution)
[08/16/2021-04:53:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_relu/Relu6 (CudaConvolution)
[08/16/2021-04:53:30] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:53:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:30] [V] [TRT] *************** Autotuning format combination: Half(256,8192,1:8,262144) -> Half(64,2048,1:8,65536) ***************
[08/16/2021-04:53:30] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,524288) ***************
[08/16/2021-04:53:30] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,524288) -> Half(1,32,1024,524288) ***************
[08/16/2021-04:53:30] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,262144) -> Half(1,32,1024:2,262144) ***************
[08/16/2021-04:53:30] [V] [TRT] *************** Autotuning format combination: Half(64,2048,1:8,65536) -> Float(1,32,1024,524288) ***************
[08/16/2021-04:53:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_relu/Relu6 (FusedConvActConvolution)
[08/16/2021-04:53:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_relu/Relu6 (CaskConvolution)
[08/16/2021-04:53:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_relu/Relu6 (CudaConvolution)
[08/16/2021-04:53:30] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_relu/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:53:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:30] [V] [TRT] *************** Autotuning format combination: Half(64,2048,1:8,65536) -> Half(64,2048,1:8,65536) ***************
[08/16/2021-04:53:30] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288), Float(1,32,1024,2097152) -> Float(1,32,1024,2097152) ***************
[08/16/2021-04:53:31] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,524288), Half(1,32,1024,2097152) -> Half(1,32,1024,2097152) ***************
[08/16/2021-04:53:31] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,262144), Half(1,32,1024:2,1048576) -> Half(1,32,1024:2,1048576) ***************
[08/16/2021-04:53:31] [V] [TRT] *************** Autotuning format combination: Half(64,2048,1:8,65536), Float(1,32,1024,2097152) -> Float(1,32,1024,2097152) ***************
[08/16/2021-04:53:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_out/Relu6 (CaskConvolution)
[08/16/2021-04:53:31] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_out/Relu6 (CudaConvolution)
[08/16/2021-04:53:31] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:31] [V] [TRT] *************** Autotuning format combination: Half(64,2048,1:8,65536), Half(256,8192,1:8,262144) -> Half(256,8192,1:8,262144) ***************
[08/16/2021-04:53:31] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,2097152) -> Float(1,32,1024,262144) ***************
[08/16/2021-04:53:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:53:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:53:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:53:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:53:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:53:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:53:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:53:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:53:31] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:53:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (FusedConvActConvolution)
[08/16/2021-04:53:31] [V] [TRT] Tactic: 589823 time 3.11387
[08/16/2021-04:53:31] [V] [TRT] Tactic: 655359 time 2.03144
[08/16/2021-04:53:31] [V] [TRT] Tactic: 786431 time 3.34379
[08/16/2021-04:53:31] [V] [TRT] Tactic: 851967 time 2.5754
[08/16/2021-04:53:31] [V] [TRT] Tactic: 1179647 time 2.30689
[08/16/2021-04:53:32] [V] [TRT] Tactic: 1310719 time 7.26162
[08/16/2021-04:53:32] [V] [TRT] Tactic: 1376255 time 2.19838
[08/16/2021-04:53:32] [V] [TRT] Tactic: 1441791 time 4.30168
[08/16/2021-04:53:32] [V] [TRT] Tactic: 1507327 time 2.5541
[08/16/2021-04:53:32] [V] [TRT] Tactic: 1638399 time 3.13971
[08/16/2021-04:53:32] [V] [TRT] Tactic: 1835007 time 3.76934
[08/16/2021-04:53:32] [V] [TRT] Tactic: 1900543 time 3.47082
[08/16/2021-04:53:33] [V] [TRT] Tactic: 2097151 time 2.68363
[08/16/2021-04:53:33] [V] [TRT] Tactic: 2162687 time 2.28535
[08/16/2021-04:53:33] [V] [TRT] Tactic: 2293759 time 2.82228
[08/16/2021-04:53:33] [V] [TRT] Tactic: 2359295 time 2.40464
[08/16/2021-04:53:33] [V] [TRT] Tactic: 2686975 time 2.31444
[08/16/2021-04:53:33] [V] [TRT] Tactic: 3080191 time 2.4018
[08/16/2021-04:53:33] [V] [TRT] Tactic: 3342335 time 2.56504
[08/16/2021-04:53:34] [V] [TRT] Tactic: 3407871 time 2.42384
[08/16/2021-04:53:34] [V] [TRT] Tactic: 3538943 time 2.28676
[08/16/2021-04:53:34] [V] [TRT] Tactic: 3670015 time 3.79082
[08/16/2021-04:53:34] [V] [TRT] Tactic: 3932159 time 2.58714
[08/16/2021-04:53:34] [V] [TRT] Tactic: 3997695 time 3.09313
[08/16/2021-04:53:34] [V] [TRT] Tactic: 4063231 time 2.56415
[08/16/2021-04:53:34] [V] [TRT] Tactic: 4194303 time 2.34473
[08/16/2021-04:53:34] [V] [TRT] Tactic: 4259839 time 2.27441
[08/16/2021-04:53:35] [V] [TRT] Tactic: 4325375 time 2.7209
[08/16/2021-04:53:35] [V] [TRT] Tactic: 4521983 time 2.95187
[08/16/2021-04:53:35] [V] [TRT] Tactic: 4587519 time 2.87401
[08/16/2021-04:53:35] [V] [TRT] Tactic: 4653055 time 2.34939
[08/16/2021-04:53:35] [V] [TRT] Tactic: 4915199 time 2.47025
[08/16/2021-04:53:35] [V] [TRT] Tactic: 4980735 time 2.63633
[08/16/2021-04:53:35] [V] [TRT] Tactic: 5177343 time 2.53681
[08/16/2021-04:53:36] [V] [TRT] Tactic: 5242879 time 2.30104
[08/16/2021-04:53:36] [V] [TRT] Tactic: 5373951 time 5.16894
[08/16/2021-04:53:36] [V] [TRT] Tactic: 5439487 time 8.76746
[08/16/2021-04:53:36] [V] [TRT] Tactic: 5570559 time 2.5213
[08/16/2021-04:53:36] [V] [TRT] Tactic: 5636095 time 2.56369
[08/16/2021-04:53:37] [V] [TRT] Tactic: 5701631 time 2.09322
[08/16/2021-04:53:38] [V] [TRT] Tactic: 5767167 time 28.6229
[08/16/2021-04:53:38] [V] [TRT] Tactic: 5832703 time 2.16989
[08/16/2021-04:53:38] [V] [TRT] Tactic: 5898239 time 2.42967
[08/16/2021-04:53:38] [V] [TRT] Tactic: 6029311 time 2.16751
[08/16/2021-04:53:38] [V] [TRT] Tactic: 6225919 time 2.3683
[08/16/2021-04:53:38] [V] [TRT] Tactic: 6291455 time 2.30798
[08/16/2021-04:53:38] [V] [TRT] Tactic: 6422527 time 2.29423
[08/16/2021-04:53:39] [V] [TRT] Tactic: 6750207 time 4.31599
[08/16/2021-04:53:39] [V] [TRT] Tactic: 6815743 time 4.96689
[08/16/2021-04:53:39] [V] [TRT] Tactic: 6946815 time 7.19952
[08/16/2021-04:53:39] [V] [TRT] Tactic: 7012351 time 2.67928
[08/16/2021-04:53:39] [V] [TRT] Tactic: 7077887 time 2.23658
[08/16/2021-04:53:40] [V] [TRT] Tactic: 7143423 time 10.0646
[08/16/2021-04:53:40] [V] [TRT] Tactic: 7208959 time 2.27618
[08/16/2021-04:53:40] [V] [TRT] Tactic: 7340031 time 2.40675
[08/16/2021-04:53:40] [V] [TRT] Tactic: 7405567 time 2.40266
[08/16/2021-04:53:40] [V] [TRT] Tactic: 7536639 time 3.28757
[08/16/2021-04:53:41] [V] [TRT] Tactic: 7602175 time 2.78762
[08/16/2021-04:53:41] [V] [TRT] Tactic: 7733247 time 2.13759
[08/16/2021-04:53:41] [V] [TRT] Tactic: 7798783 time 3.28084
[08/16/2021-04:53:41] [V] [TRT] Tactic: 8191999 time 8.87488
[08/16/2021-04:53:41] [V] [TRT] Tactic: 8257535 time 2.68466
[08/16/2021-04:53:41] [V] [TRT] Tactic: 8323071 time 3.11767
[08/16/2021-04:53:42] [V] [TRT] Tactic: 8650751 time 3.36366
[08/16/2021-04:53:42] [V] [TRT] Tactic: 8716287 time 5.60459
[08/16/2021-04:53:42] [V] [TRT] Tactic: 9109503 time 2.80596
[08/16/2021-04:53:42] [V] [TRT] Tactic: 9568255 time 2.42225
[08/16/2021-04:53:42] [V] [TRT] Tactic: 9895935 time 2.38162
[08/16/2021-04:53:42] [V] [TRT] Tactic: 10223615 time 2.28802
[08/16/2021-04:53:43] [V] [TRT] Tactic: 10354687 time 2.2754
[08/16/2021-04:53:43] [V] [TRT] Tactic: 10551295 time 3.02341
[08/16/2021-04:53:43] [V] [TRT] Tactic: 10747903 time 2.03279
[08/16/2021-04:53:43] [V] [TRT] Tactic: 10944511 time 2.64115
[08/16/2021-04:53:43] [V] [TRT] Fastest Tactic: 655359 Time: 2.03144
[08/16/2021-04:53:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (CaskConvolution)
[08/16/2021-04:53:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:53:43] [V] [TRT] Tactic: 1754569683116234317 time 1.4591
[08/16/2021-04:53:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:53:43] [V] [TRT] Tactic: 1825138533642645384 time 1.4678
[08/16/2021-04:53:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:53:43] [V] [TRT] Tactic: 2733356012094739613 time 1.69473
[08/16/2021-04:53:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:53:43] [V] [TRT] Tactic: 3915320020053085238 time 1.46252
[08/16/2021-04:53:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:53:43] [V] [TRT] Tactic: 6808617066150061604 time 1.50651
[08/16/2021-04:53:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:53:43] [V] [TRT] Tactic: 9091006216302412844 time 1.4564
[08/16/2021-04:53:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:53:43] [V] [TRT] Tactic: -8060443123034038864 time 1.52081
[08/16/2021-04:53:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:53:43] [V] [TRT] Tactic: -4420849921117327522 time 1.71292
[08/16/2021-04:53:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:53:43] [V] [TRT] Tactic: -3946921629105938337 time 1.66726
[08/16/2021-04:53:43] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 1.4564
[08/16/2021-04:53:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (CudaConvolution)
[08/16/2021-04:53:43] [V] [TRT] Tactic: 0 time 2.15553
[08/16/2021-04:53:43] [V] [TRT] Tactic: 2 time 2.27121
[08/16/2021-04:53:43] [V] [TRT] Tactic: 5 skipped. Scratch requested: 81330176, available: 16777216
[08/16/2021-04:53:43] [V] [TRT] Tactic: 57 time 2.09174
[08/16/2021-04:53:43] [V] [TRT] Fastest Tactic: 57 Time: 2.09174
[08/16/2021-04:53:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (CudaDepthwiseConvolution)
[08/16/2021-04:53:43] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844
[08/16/2021-04:53:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:53:43] [V] [TRT] 
[08/16/2021-04:53:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:53:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:53:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:53:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:53:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:53:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:53:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:53:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:53:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:53:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:53:43] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,2097152) -> Half(1,32,1024,262144) ***************
[08/16/2021-04:53:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (FusedConvActConvolution)
[08/16/2021-04:53:43] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (CaskConvolution)
[08/16/2021-04:53:43] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (CudaConvolution)
[08/16/2021-04:53:43] [V] [TRT] Tactic: 0 time 2.32526
[08/16/2021-04:53:44] [V] [TRT] Tactic: 1 time 2.44631
[08/16/2021-04:53:44] [V] [TRT] Tactic: 2 time 2.196
[08/16/2021-04:53:44] [V] [TRT] Tactic: 4 skipped. Scratch requested: 4583325696, available: 16777216
[08/16/2021-04:53:44] [V] [TRT] Tactic: 5 skipped. Scratch requested: 81330176, available: 16777216
[08/16/2021-04:53:44] [V] [TRT] Fastest Tactic: 2 Time: 2.196
[08/16/2021-04:53:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (CudaDepthwiseConvolution)
[08/16/2021-04:53:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2
[08/16/2021-04:53:44] [V] [TRT] 
[08/16/2021-04:53:44] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,1048576) -> Half(1,32,1024:2,131072) ***************
[08/16/2021-04:53:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:53:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:53:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:53:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:53:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:53:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:53:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:53:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:53:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:53:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (FusedConvActConvolution)
[08/16/2021-04:53:44] [V] [TRT] Tactic: 589823 time 1.58748
[08/16/2021-04:53:44] [V] [TRT] Tactic: 655359 time 1.01767
[08/16/2021-04:53:44] [V] [TRT] Tactic: 786431 time 1.55462
[08/16/2021-04:53:44] [V] [TRT] Tactic: 851967 time 1.30102
[08/16/2021-04:53:44] [V] [TRT] Tactic: 1179647 time 1.23676
[08/16/2021-04:53:44] [V] [TRT] Tactic: 1310719 time 7.21163
[08/16/2021-04:53:44] [V] [TRT] Tactic: 1376255 time 1.04852
[08/16/2021-04:53:44] [V] [TRT] Tactic: 1441791 time 2.04756
[08/16/2021-04:53:44] [V] [TRT] Tactic: 1507327 time 1.28471
[08/16/2021-04:53:45] [V] [TRT] Tactic: 1638399 time 1.60103
[08/16/2021-04:53:45] [V] [TRT] Tactic: 1835007 time 1.52065
[08/16/2021-04:53:45] [V] [TRT] Tactic: 1900543 time 1.51401
[08/16/2021-04:53:45] [V] [TRT] Tactic: 2097151 time 1.57357
[08/16/2021-04:53:45] [V] [TRT] Tactic: 2162687 time 1.08641
[08/16/2021-04:53:45] [V] [TRT] Tactic: 2293759 time 1.35626
[08/16/2021-04:53:45] [V] [TRT] Tactic: 2359295 time 1.11864
[08/16/2021-04:53:45] [V] [TRT] Tactic: 2686975 time 1.39121
[08/16/2021-04:53:45] [V] [TRT] Tactic: 3080191 time 1.20768
[08/16/2021-04:53:45] [V] [TRT] Tactic: 3342335 time 1.2896
[08/16/2021-04:53:45] [V] [TRT] Tactic: 3407871 time 1.16826
[08/16/2021-04:53:45] [V] [TRT] Tactic: 3538943 time 1.11589
[08/16/2021-04:53:45] [V] [TRT] Tactic: 3670015 time 1.91554
[08/16/2021-04:53:46] [V] [TRT] Tactic: 3932159 time 1.29608
[08/16/2021-04:53:46] [V] [TRT] Tactic: 3997695 time 1.62894
[08/16/2021-04:53:46] [V] [TRT] Tactic: 4063231 time 1.29947
[08/16/2021-04:53:46] [V] [TRT] Tactic: 4194303 time 1.25556
[08/16/2021-04:53:46] [V] [TRT] Tactic: 4259839 time 1.21735
[08/16/2021-04:53:46] [V] [TRT] Tactic: 4325375 time 1.43552
[08/16/2021-04:53:46] [V] [TRT] Tactic: 4521983 time 1.44758
[08/16/2021-04:53:46] [V] [TRT] Tactic: 4587519 time 1.41398
[08/16/2021-04:53:46] [V] [TRT] Tactic: 4653055 time 1.16984
[08/16/2021-04:53:46] [V] [TRT] Tactic: 4915199 time 1.26532
[08/16/2021-04:53:46] [V] [TRT] Tactic: 4980735 time 1.55025
[08/16/2021-04:53:46] [V] [TRT] Tactic: 5177343 time 1.29336
[08/16/2021-04:53:46] [V] [TRT] Tactic: 5242879 time 1.22293
[08/16/2021-04:53:47] [V] [TRT] Tactic: 5373951 time 2.08293
[08/16/2021-04:53:47] [V] [TRT] Tactic: 5439487 time 3.21478
[08/16/2021-04:53:47] [V] [TRT] Tactic: 5570559 time 1.26637
[08/16/2021-04:53:47] [V] [TRT] Tactic: 5636095 time 1.30092
[08/16/2021-04:53:47] [V] [TRT] Tactic: 5701631 time 1.38154
[08/16/2021-04:53:47] [V] [TRT] Tactic: 5767167 time 11.5568
[08/16/2021-04:53:47] [V] [TRT] Tactic: 5832703 time 1.00207
[08/16/2021-04:53:48] [V] [TRT] Tactic: 5898239 time 1.1385
[08/16/2021-04:53:48] [V] [TRT] Tactic: 6029311 time 1.33172
[08/16/2021-04:53:48] [V] [TRT] Tactic: 6225919 time 1.1458
[08/16/2021-04:53:48] [V] [TRT] Tactic: 6291455 time 1.23463
[08/16/2021-04:53:48] [V] [TRT] Tactic: 6422527 time 1.15227
[08/16/2021-04:53:48] [V] [TRT] Tactic: 6750207 time 2.00731
[08/16/2021-04:53:48] [V] [TRT] Tactic: 6815743 time 1.69336
[08/16/2021-04:53:48] [V] [TRT] Tactic: 6946815 time 2.75728
[08/16/2021-04:53:48] [V] [TRT] Tactic: 7012351 time 1.57901
[08/16/2021-04:53:48] [V] [TRT] Tactic: 7077887 time 1.04286
[08/16/2021-04:53:48] [V] [TRT] Tactic: 7143423 time 3.35366
[08/16/2021-04:53:48] [V] [TRT] Tactic: 7208959 time 1.02588
[08/16/2021-04:53:49] [V] [TRT] Tactic: 7340031 time 1.21318
[08/16/2021-04:53:49] [V] [TRT] Tactic: 7405567 time 1.20103
[08/16/2021-04:53:49] [V] [TRT] Tactic: 7536639 time 1.67109
[08/16/2021-04:53:49] [V] [TRT] Tactic: 7602175 time 1.53467
[08/16/2021-04:53:49] [V] [TRT] Tactic: 7733247 time 1.01536
[08/16/2021-04:53:49] [V] [TRT] Tactic: 7798783 time 1.55621
[08/16/2021-04:53:49] [V] [TRT] Tactic: 8191999 time 3.83323
[08/16/2021-04:53:49] [V] [TRT] Tactic: 8257535 time 1.41467
[08/16/2021-04:53:49] [V] [TRT] Tactic: 8323071 time 1.64204
[08/16/2021-04:53:49] [V] [TRT] Tactic: 8650751 time 1.63445
[08/16/2021-04:53:49] [V] [TRT] Tactic: 8716287 time 2.40795
[08/16/2021-04:53:50] [V] [TRT] Tactic: 9109503 time 1.57786
[08/16/2021-04:53:50] [V] [TRT] Tactic: 9568255 time 1.28179
[08/16/2021-04:53:50] [V] [TRT] Tactic: 9895935 time 1.2463
[08/16/2021-04:53:50] [V] [TRT] Tactic: 10223615 time 1.38776
[08/16/2021-04:53:50] [V] [TRT] Tactic: 10354687 time 1.15684
[08/16/2021-04:53:50] [V] [TRT] Tactic: 10551295 time 1.49029
[08/16/2021-04:53:50] [V] [TRT] Tactic: 10747903 time 0.980476
[08/16/2021-04:53:50] [V] [TRT] Tactic: 10944511 time 1.54395
[08/16/2021-04:53:50] [V] [TRT] Fastest Tactic: 10747903 Time: 0.980476
[08/16/2021-04:53:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (CaskConvolution)
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: 2418518597804310654 time 0.795164
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: 8292881859266835088 time 0.80728
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: 8401509141903434922 time 0.7843
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: -8654297089785671176 time 0.759608
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: -7140760933967189247 time 0.749452
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: -4097850214384059472 time 0.772276
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: -3689982367035295496 time 0.757264
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: -2534402059426524406 time 0.740748
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: -2027588946874785071 time 0.99884
[08/16/2021-04:53:50] [V] [TRT] Fastest Tactic: -2534402059426524406 Time: 0.740748
[08/16/2021-04:53:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (CudaConvolution)
[08/16/2021-04:53:50] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (CudaDepthwiseConvolution)
[08/16/2021-04:53:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2534402059426524406
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:53:50] [V] [TRT] 
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:53:50] [V] [TRT] *************** Autotuning format combination: Half(256,8192,1:8,262144) -> Float(1,32,1024,262144) ***************
[08/16/2021-04:53:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (FusedConvActConvolution)
[08/16/2021-04:53:50] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (CaskConvolution)
[08/16/2021-04:53:50] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (CudaConvolution)
[08/16/2021-04:53:50] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (CudaDepthwiseConvolution)
[08/16/2021-04:53:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:50] [V] [TRT] *************** Autotuning format combination: Half(256,8192,1:8,262144) -> Half(32,1024,1:8,32768) ***************
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (FusedConvActConvolution)
[08/16/2021-04:53:50] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (CaskConvolution)
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: 2105695814191699972 time 0.318728
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: 3754069740140581927 time 0.312908
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: 5666160310350604399 time 0.320692
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: 5925270497649423688 time 0.314052
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: 6680916730816870145 time 0.287988
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: 7158029511300006471 time 0.327828
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: 7859952145590271433 time 0.287448
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: 8283847742354150423 time 0.321436
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: -8391760416076885205 time 0.319376
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: -4534876761957424274 time 0.32654
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: -3237051169894153788 time 0.322156
[08/16/2021-04:53:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:50] [V] [TRT] Tactic: -2422160065350346448 time 0.279628
[08/16/2021-04:53:50] [V] [TRT] Fastest Tactic: -2422160065350346448 Time: 0.279628
[08/16/2021-04:53:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (CudaConvolution)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 4.3997
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1 time 2.65912
[08/16/2021-04:53:51] [V] [TRT] Tactic: 2 time 4.23168
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 1 Time: 2.65912
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (CudaDepthwiseConvolution)
[08/16/2021-04:53:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2422160065350346448
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:51] [V] [TRT] 
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.082296
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.170924
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 1002 Time: 0.082296
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.063128
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.063688
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 1002 Time: 0.063128
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.108836
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.040208
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.040208
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.081744
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.039652
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.039652
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.069092
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.0583
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.0583
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.082132
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.17348
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 1002 Time: 0.082132
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.109904
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.033316
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.033316
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.080064
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.032604
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.032604
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.132924
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.044008
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.044008
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.081364
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.17328
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 1002 Time: 0.081364
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.134868
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.0323
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.0323
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.079532
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.031924
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.031924
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.081828
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.038812
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.038812
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.080944
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.203056
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 1002 Time: 0.080944
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.081196
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.027756
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.027756
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.117716
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.027564
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.027564
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.06276
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.063428
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 1002 Time: 0.06276
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.10848
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.039652
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.039652
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.079456
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.039412
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.039412
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.12434
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.067476
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.067476
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.12462
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.063988
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.063988
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.114144
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.067444
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.067444
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.084024
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.060132
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.060132
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.069476
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.058584
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.058584
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.109752
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.033212
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.033212
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.080472
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.032788
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.032788
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.13256
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.043976
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.043976
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.132432
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.031928
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.031928
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.079952
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.032452
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.032452
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.081028
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.03848
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.03848
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.080224
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.0276
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.0276
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1002 time 0.118172
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.027912
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.027912
[08/16/2021-04:53:51] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,16,256,65536) ***************
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (FusedConvActConvolution)
[08/16/2021-04:53:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (CaskConvolution)
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:53:51] [V] [TRT] Tactic: 1825138533642645384 time 0.566412
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:53:51] [V] [TRT] Tactic: 2842488832350522458 time 0.575184
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:53:51] [V] [TRT] Tactic: 3915320020053085238 time 0.555308
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:53:51] [V] [TRT] Tactic: 6448355332020552203 time 0.56368
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:53:51] [V] [TRT] Tactic: 6808617066150061604 time 0.577192
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:53:51] [V] [TRT] Tactic: -8060443123034038864 time 0.593988
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:53:51] [V] [TRT] Tactic: -4420849921117327522 time 0.566672
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:53:51] [V] [TRT] Tactic: -3946921629105938337 time 0.745268
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 3915320020053085238 Time: 0.555308
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (CudaConvolution)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.736308
[08/16/2021-04:53:51] [V] [TRT] Tactic: 2 time 0.752784
[08/16/2021-04:53:51] [V] [TRT] Tactic: 5 skipped. Scratch requested: 290784256, available: 16777216
[08/16/2021-04:53:51] [V] [TRT] Tactic: 57 time 1.29092
[08/16/2021-04:53:51] [V] [TRT] Fastest Tactic: 0 Time: 0.736308
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:53:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3915320020053085238
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:53:51] [V] [TRT] 
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:53:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:53:51] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144) -> Half(1,16,256,65536) ***************
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (FusedConvActConvolution)
[08/16/2021-04:53:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (CaskConvolution)
[08/16/2021-04:53:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (CudaConvolution)
[08/16/2021-04:53:51] [V] [TRT] Tactic: 0 time 0.917548
[08/16/2021-04:53:52] [V] [TRT] Tactic: 1 time 1.33158
[08/16/2021-04:53:52] [V] [TRT] Tactic: 2 time 0.808436
[08/16/2021-04:53:52] [V] [TRT] Tactic: 5 skipped. Scratch requested: 290226688, available: 16777216
[08/16/2021-04:53:52] [V] [TRT] Fastest Tactic: 2 Time: 0.808436
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:53:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2
[08/16/2021-04:53:52] [V] [TRT] 
[08/16/2021-04:53:52] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072) -> Half(1,16,256:2,32768) ***************
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (FusedConvActConvolution)
[08/16/2021-04:53:52] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (CaskConvolution)
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:53:52] [V] [TRT] Tactic: 1145226902788474763 time 0.312028
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:53:52] [V] [TRT] Tactic: 2418518597804310654 time 0.310048
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:53:52] [V] [TRT] Tactic: 8292881859266835088 time 0.331472
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:53:52] [V] [TRT] Tactic: 8401509141903434922 time 0.298776
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:53:52] [V] [TRT] Tactic: -8654297089785671176 time 0.286016
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:53:52] [V] [TRT] Tactic: -7448936905981214224 time 0.34674
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:53:52] [V] [TRT] Tactic: -3689982367035295496 time 0.290392
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:53:52] [V] [TRT] Tactic: -2027588946874785071 time 0.310708
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:53:52] [V] [TRT] Tactic: -245090590808296743 time 0.293592
[08/16/2021-04:53:52] [V] [TRT] Fastest Tactic: -8654297089785671176 Time: 0.286016
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (CudaConvolution)
[08/16/2021-04:53:52] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:53:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8654297089785671176
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:53:52] [V] [TRT] 
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:53:52] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Float(1,16,256,65536) ***************
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (FusedConvActConvolution)
[08/16/2021-04:53:52] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (CaskConvolution)
[08/16/2021-04:53:52] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (CudaConvolution)
[08/16/2021-04:53:52] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:53:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:52] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Half(32,512,1:8,8192) ***************
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (FusedConvActConvolution)
[08/16/2021-04:53:52] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (CaskConvolution)
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] Tactic: 3754069740140581927 time 0.140772
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] Tactic: 5925270497649423688 time 0.16412
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] Tactic: 6680916730816870145 time 0.105612
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] Tactic: 7158029511300006471 time 0.135196
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] Tactic: 7859952145590271433 time 0.10524
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] Tactic: 8283847742354150423 time 0.13478
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] Tactic: -4534876761957424274 time 0.164452
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] Tactic: -3237051169894153788 time 0.134276
[08/16/2021-04:53:52] [V] [TRT] Fastest Tactic: 7859952145590271433 Time: 0.10524
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (CudaConvolution)
[08/16/2021-04:53:52] [V] [TRT] Tactic: 0 time 1.33917
[08/16/2021-04:53:52] [V] [TRT] Tactic: 1 time 1.14614
[08/16/2021-04:53:52] [V] [TRT] Tactic: 2 time 0.957704
[08/16/2021-04:53:52] [V] [TRT] Fastest Tactic: 2 Time: 0.957704
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:53:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:53:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7859952145590271433
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] 
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:52] [V] [TRT] Tactic: 1002 time 0.011484
[08/16/2021-04:53:52] [V] [TRT] Tactic: 0 time 0.019228
[08/16/2021-04:53:52] [V] [TRT] Fastest Tactic: 1002 Time: 0.011484
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:52] [V] [TRT] Tactic: 1002 time 0.032792
[08/16/2021-04:53:52] [V] [TRT] Tactic: 0 time 0.011516
[08/16/2021-04:53:52] [V] [TRT] Fastest Tactic: 0 Time: 0.011516
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:52] [V] [TRT] Tactic: 1002 time 0.022984
[08/16/2021-04:53:52] [V] [TRT] Tactic: 0 time 0.011476
[08/16/2021-04:53:52] [V] [TRT] Fastest Tactic: 0 Time: 0.011476
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:52] [V] [TRT] Tactic: 1002 time 0.01132
[08/16/2021-04:53:52] [V] [TRT] Tactic: 0 time 0.018304
[08/16/2021-04:53:52] [V] [TRT] Fastest Tactic: 1002 Time: 0.01132
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:52] [V] [TRT] Tactic: 1002 time 0.032128
[08/16/2021-04:53:52] [V] [TRT] Tactic: 0 time 0.011544
[08/16/2021-04:53:52] [V] [TRT] Fastest Tactic: 0 Time: 0.011544
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:52] [V] [TRT] Tactic: 1002 time 0.023256
[08/16/2021-04:53:52] [V] [TRT] Tactic: 0 time 0.01132
[08/16/2021-04:53:52] [V] [TRT] Fastest Tactic: 0 Time: 0.01132
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:52] [V] [TRT] Tactic: 1002 time 0.03506
[08/16/2021-04:53:52] [V] [TRT] Tactic: 0 time 0.010168
[08/16/2021-04:53:52] [V] [TRT] Fastest Tactic: 0 Time: 0.010168
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:52] [V] [TRT] Tactic: 1002 time 0.035108
[08/16/2021-04:53:52] [V] [TRT] Tactic: 0 time 0.009416
[08/16/2021-04:53:52] [V] [TRT] Fastest Tactic: 0 Time: 0.009416
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:52] [V] [TRT] Tactic: 1002 time 0.023452
[08/16/2021-04:53:52] [V] [TRT] Tactic: 0 time 0.007596
[08/16/2021-04:53:52] [V] [TRT] Fastest Tactic: 0 Time: 0.007596
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:52] [V] [TRT] Tactic: 1002 time 0.022488
[08/16/2021-04:53:52] [V] [TRT] Tactic: 0 time 0.010776
[08/16/2021-04:53:52] [V] [TRT] Fastest Tactic: 0 Time: 0.010776
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:52] [V] [TRT] Tactic: 1002 time 0.0233
[08/16/2021-04:53:52] [V] [TRT] Tactic: 0 time 0.008624
[08/16/2021-04:53:52] [V] [TRT] Fastest Tactic: 0 Time: 0.008624
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:53:52] [V] [TRT] Tactic: 1002 time 0.034892
[08/16/2021-04:53:52] [V] [TRT] Tactic: 0 time 0.00764
[08/16/2021-04:53:52] [V] [TRT] Fastest Tactic: 0 Time: 0.00764
[08/16/2021-04:53:52] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,524288) ***************
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:53:52] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:53:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (FusedConvActConvolution)
[08/16/2021-04:53:52] [V] [TRT] Tactic: 524287 time 4.01903
[08/16/2021-04:53:53] [V] [TRT] Tactic: 720895 time 4.0522
[08/16/2021-04:53:53] [V] [TRT] Tactic: 983039 time 3.7638
[08/16/2021-04:53:53] [V] [TRT] Tactic: 1048575 time 3.80041
[08/16/2021-04:53:53] [V] [TRT] Tactic: 1703935 time 3.6781
[08/16/2021-04:53:53] [V] [TRT] Tactic: 1769471 time 4.85147
[08/16/2021-04:53:54] [V] [TRT] Tactic: 1966079 time 3.33717
[08/16/2021-04:53:54] [V] [TRT] Tactic: 2031615 time 4.30622
[08/16/2021-04:53:54] [V] [TRT] Tactic: 2228223 time 3.70692
[08/16/2021-04:53:54] [V] [TRT] Tactic: 2424831 time 3.74643
[08/16/2021-04:53:54] [V] [TRT] Tactic: 2621439 time 3.91848
[08/16/2021-04:53:54] [V] [TRT] Tactic: 2752511 time 3.82722
[08/16/2021-04:53:55] [V] [TRT] Tactic: 2818047 time 4.15382
[08/16/2021-04:53:55] [V] [TRT] Tactic: 2883583 time 3.97995
[08/16/2021-04:53:55] [V] [TRT] Tactic: 3014655 time 3.62708
[08/16/2021-04:53:55] [V] [TRT] Tactic: 3145727 time 3.80301
[08/16/2021-04:53:55] [V] [TRT] Tactic: 3473407 time 4.23704
[08/16/2021-04:53:56] [V] [TRT] Tactic: 3604479 time 3.61052
[08/16/2021-04:53:56] [V] [TRT] Tactic: 3735551 time 7.05275
[08/16/2021-04:53:56] [V] [TRT] Tactic: 4390911 time 3.95619
[08/16/2021-04:53:56] [V] [TRT] Tactic: 5046271 time 4.55134
[08/16/2021-04:53:57] [V] [TRT] Tactic: 5963775 time 3.76162
[08/16/2021-04:53:57] [V] [TRT] Tactic: 6160383 time 4.21084
[08/16/2021-04:53:57] [V] [TRT] Tactic: 6488063 time 3.9584
[08/16/2021-04:53:57] [V] [TRT] Tactic: 6881279 time 4.27802
[08/16/2021-04:53:57] [V] [TRT] Tactic: 7274495 time 5.31596
[08/16/2021-04:53:58] [V] [TRT] Tactic: 7864319 time 4.17747
[08/16/2021-04:53:58] [V] [TRT] Tactic: 7995391 time 3.29622
[08/16/2021-04:53:58] [V] [TRT] Tactic: 8585215 time 4.06488
[08/16/2021-04:53:58] [V] [TRT] Tactic: 8847359 time 4.87998
[08/16/2021-04:53:58] [V] [TRT] Tactic: 8978431 time 3.7895
[08/16/2021-04:53:59] [V] [TRT] Tactic: 9043967 time 3.89441
[08/16/2021-04:53:59] [V] [TRT] Tactic: 9175039 time 3.61506
[08/16/2021-04:53:59] [V] [TRT] Tactic: 9502719 time 3.88964
[08/16/2021-04:53:59] [V] [TRT] Tactic: 9830399 time 5.18046
[08/16/2021-04:54:00] [V] [TRT] Tactic: 9961471 time 4.15751
[08/16/2021-04:54:00] [V] [TRT] Tactic: 10027007 time 4.1004
[08/16/2021-04:54:00] [V] [TRT] Tactic: 10092543 time 3.95009
[08/16/2021-04:54:00] [V] [TRT] Tactic: 10289151 time 3.33
[08/16/2021-04:54:00] [V] [TRT] Tactic: 10485759 time 4.20388
[08/16/2021-04:54:00] [V] [TRT] Tactic: 10682367 time 3.7065
[08/16/2021-04:54:01] [V] [TRT] Tactic: 10813439 time 3.24224
[08/16/2021-04:54:01] [V] [TRT] Fastest Tactic: 10813439 Time: 3.24224
[08/16/2021-04:54:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (CaskConvolution)
[08/16/2021-04:54:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:54:01] [V] [TRT] Tactic: 1825138533642645384 time 3.27024
[08/16/2021-04:54:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:54:01] [V] [TRT] Tactic: 2842488832350522458 time 3.11335
[08/16/2021-04:54:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:54:01] [V] [TRT] Tactic: 3915320020053085238 time 3.25417
[08/16/2021-04:54:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:54:01] [V] [TRT] Tactic: 6448355332020552203 time 3.37285
[08/16/2021-04:54:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:01] [V] [TRT] Tactic: 6808617066150061604 time 3.06224
[08/16/2021-04:54:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:54:01] [V] [TRT] Tactic: -8060443123034038864 time 3.12937
[08/16/2021-04:54:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:54:01] [V] [TRT] Tactic: -4420849921117327522 time 3.5145
[08/16/2021-04:54:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:54:01] [V] [TRT] Tactic: -3946921629105938337 time 3.41811
[08/16/2021-04:54:01] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 3.06224
[08/16/2021-04:54:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (CudaConvolution)
[08/16/2021-04:54:01] [V] [TRT] Tactic: 0 time 4.75183
[08/16/2021-04:54:01] [V] [TRT] Tactic: 2 time 5.03685
[08/16/2021-04:54:01] [V] [TRT] Tactic: 5 skipped. Scratch requested: 577110016, available: 16777216
[08/16/2021-04:54:01] [V] [TRT] Tactic: 6 time 2.1936
[08/16/2021-04:54:02] [V] [TRT] Tactic: 57 time 4.15032
[08/16/2021-04:54:02] [V] [TRT] Fastest Tactic: 6 Time: 2.1936
[08/16/2021-04:54:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6
[08/16/2021-04:54:02] [V] [TRT] 
[08/16/2021-04:54:02] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144) -> Half(1,32,1024,524288) ***************
[08/16/2021-04:54:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (CaskConvolution)
[08/16/2021-04:54:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (CudaConvolution)
[08/16/2021-04:54:02] [V] [TRT] Tactic: 0 time 4.95976
[08/16/2021-04:54:02] [V] [TRT] Tactic: 1 time 3.71588
[08/16/2021-04:54:02] [V] [TRT] Tactic: 2 time 4.29811
[08/16/2021-04:54:02] [V] [TRT] Tactic: 4 skipped. Scratch requested: 4442554368, available: 16777216
[08/16/2021-04:54:02] [V] [TRT] Tactic: 5 skipped. Scratch requested: 577110016, available: 16777216
[08/16/2021-04:54:02] [V] [TRT] Tactic: 6 skipped. Scratch requested: 20974080, available: 16777216
[08/16/2021-04:54:02] [V] [TRT] Fastest Tactic: 1 Time: 3.71588
[08/16/2021-04:54:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:54:02] [V] [TRT] 
[08/16/2021-04:54:02] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072) -> Half(1,32,1024:2,262144) ***************
[08/16/2021-04:54:02] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:54:02] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:02] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:02] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:02] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:02] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:54:02] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:02] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:02] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:54:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:02] [V] [TRT] Tactic: 524287 time 2.11942
[08/16/2021-04:54:02] [V] [TRT] Tactic: 720895 time 2.20812
[08/16/2021-04:54:02] [V] [TRT] Tactic: 983039 time 2.02849
[08/16/2021-04:54:02] [V] [TRT] Tactic: 1048575 time 1.95958
[08/16/2021-04:54:02] [V] [TRT] Tactic: 1703935 time 1.99706
[08/16/2021-04:54:02] [V] [TRT] Tactic: 1769471 time 2.48682
[08/16/2021-04:54:03] [V] [TRT] Tactic: 1966079 time 1.71782
[08/16/2021-04:54:03] [V] [TRT] Tactic: 2031615 time 2.03521
[08/16/2021-04:54:03] [V] [TRT] Tactic: 2228223 time 1.8739
[08/16/2021-04:54:03] [V] [TRT] Tactic: 2424831 time 1.89666
[08/16/2021-04:54:03] [V] [TRT] Tactic: 2621439 time 1.97646
[08/16/2021-04:54:03] [V] [TRT] Tactic: 2752511 time 2.07565
[08/16/2021-04:54:03] [V] [TRT] Tactic: 2818047 time 2.05538
[08/16/2021-04:54:03] [V] [TRT] Tactic: 2883583 time 1.94607
[08/16/2021-04:54:03] [V] [TRT] Tactic: 3014655 time 1.7482
[08/16/2021-04:54:04] [V] [TRT] Tactic: 3145727 time 1.9909
[08/16/2021-04:54:04] [V] [TRT] Tactic: 3473407 time 2.12381
[08/16/2021-04:54:04] [V] [TRT] Tactic: 3604479 time 1.74708
[08/16/2021-04:54:04] [V] [TRT] Tactic: 3735551 time 2.77246
[08/16/2021-04:54:04] [V] [TRT] Tactic: 4390911 time 1.9813
[08/16/2021-04:54:04] [V] [TRT] Tactic: 5046271 time 2.47925
[08/16/2021-04:54:04] [V] [TRT] Tactic: 5963775 time 1.88818
[08/16/2021-04:54:04] [V] [TRT] Tactic: 6160383 time 2.05044
[08/16/2021-04:54:04] [V] [TRT] Tactic: 6488063 time 2.01426
[08/16/2021-04:54:05] [V] [TRT] Tactic: 6881279 time 2.01454
[08/16/2021-04:54:05] [V] [TRT] Tactic: 7274495 time 2.44342
[08/16/2021-04:54:05] [V] [TRT] Tactic: 7864319 time 2.2099
[08/16/2021-04:54:05] [V] [TRT] Tactic: 7995391 time 1.90066
[08/16/2021-04:54:05] [V] [TRT] Tactic: 8585215 time 2.23811
[08/16/2021-04:54:05] [V] [TRT] Tactic: 8847359 time 2.55693
[08/16/2021-04:54:05] [V] [TRT] Tactic: 8978431 time 1.91352
[08/16/2021-04:54:05] [V] [TRT] Tactic: 9043967 time 1.93008
[08/16/2021-04:54:05] [V] [TRT] Tactic: 9175039 time 1.74998
[08/16/2021-04:54:06] [V] [TRT] Tactic: 9502719 time 1.96378
[08/16/2021-04:54:06] [V] [TRT] Tactic: 9830399 time 2.30702
[08/16/2021-04:54:06] [V] [TRT] Tactic: 9961471 time 2.1146
[08/16/2021-04:54:06] [V] [TRT] Tactic: 10027007 time 2.35638
[08/16/2021-04:54:06] [V] [TRT] Tactic: 10092543 time 1.97959
[08/16/2021-04:54:06] [V] [TRT] Tactic: 10289151 time 1.70653
[08/16/2021-04:54:06] [V] [TRT] Tactic: 10485759 time 2.37717
[08/16/2021-04:54:06] [V] [TRT] Tactic: 10682367 time 1.9564
[08/16/2021-04:54:06] [V] [TRT] Tactic: 10813439 time 1.74439
[08/16/2021-04:54:06] [V] [TRT] Fastest Tactic: 10289151 Time: 1.70653
[08/16/2021-04:54:06] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (CaskConvolution)
[08/16/2021-04:54:06] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:54:06] [V] [TRT] Tactic: 1145226902788474763 time 1.58103
[08/16/2021-04:54:06] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:07] [V] [TRT] Tactic: 2418518597804310654 time 1.58052
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:07] [V] [TRT] Tactic: 8292881859266835088 time 1.77396
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:07] [V] [TRT] Tactic: 8401509141903434922 time 1.57192
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:07] [V] [TRT] Tactic: -8654297089785671176 time 1.68852
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:54:07] [V] [TRT] Tactic: -7448936905981214224 time 1.73695
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:07] [V] [TRT] Tactic: -3689982367035295496 time 1.71146
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:07] [V] [TRT] Tactic: -2027588946874785071 time 1.74001
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:54:07] [V] [TRT] Tactic: -245090590808296743 time 1.73883
[08/16/2021-04:54:07] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 1.57192
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (CudaConvolution)
[08/16/2021-04:54:07] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:07] [V] [TRT] 
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:07] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Float(1,32,1024,524288) ***************
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (CaskConvolution)
[08/16/2021-04:54:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (CudaConvolution)
[08/16/2021-04:54:07] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:07] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Half(64,2048,1:8,65536) ***************
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (CaskConvolution)
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] Tactic: 3754069740140581927 time 0.531156
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] Tactic: 5925270497649423688 time 0.492488
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] Tactic: 6680916730816870145 time 0.57286
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] Tactic: 7158029511300006471 time 0.538336
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] Tactic: 7859952145590271433 time 0.577596
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] Tactic: 8283847742354150423 time 0.521736
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] Tactic: -4534876761957424274 time 0.504932
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] Tactic: -3237051169894153788 time 0.529228
[08/16/2021-04:54:07] [V] [TRT] Fastest Tactic: 5925270497649423688 Time: 0.492488
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (CudaConvolution)
[08/16/2021-04:54:07] [V] [TRT] Tactic: 0 time 9.61071
[08/16/2021-04:54:07] [V] [TRT] Tactic: 1 time 3.87926
[08/16/2021-04:54:07] [V] [TRT] Tactic: 2 time 4.58199
[08/16/2021-04:54:07] [V] [TRT] Tactic: 6 skipped. Scratch requested: 20974080, available: 16777216
[08/16/2021-04:54:07] [V] [TRT] Fastest Tactic: 1 Time: 3.87926
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5925270497649423688
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] 
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:07] [V] [TRT] Tactic: 1002 time 0.117488
[08/16/2021-04:54:07] [V] [TRT] Tactic: 0 time 0.116548
[08/16/2021-04:54:07] [V] [TRT] Fastest Tactic: 0 Time: 0.116548
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:07] [V] [TRT] Tactic: 1002 time 0.209056
[08/16/2021-04:54:07] [V] [TRT] Tactic: 0 time 0.073596
[08/16/2021-04:54:07] [V] [TRT] Fastest Tactic: 0 Time: 0.073596
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:07] [V] [TRT] Tactic: 1002 time 0.153992
[08/16/2021-04:54:07] [V] [TRT] Tactic: 0 time 0.073776
[08/16/2021-04:54:07] [V] [TRT] Fastest Tactic: 0 Time: 0.073776
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:07] [V] [TRT] Tactic: 1002 time 0.132116
[08/16/2021-04:54:07] [V] [TRT] Tactic: 0 time 0.110444
[08/16/2021-04:54:07] [V] [TRT] Fastest Tactic: 0 Time: 0.110444
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:07] [V] [TRT] Tactic: 1002 time 0.205696
[08/16/2021-04:54:07] [V] [TRT] Tactic: 0 time 0.060424
[08/16/2021-04:54:07] [V] [TRT] Fastest Tactic: 0 Time: 0.060424
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:07] [V] [TRT] Tactic: 1002 time 0.154532
[08/16/2021-04:54:07] [V] [TRT] Tactic: 0 time 0.05652
[08/16/2021-04:54:07] [V] [TRT] Fastest Tactic: 0 Time: 0.05652
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:07] [V] [TRT] Tactic: 1002 time 0.252796
[08/16/2021-04:54:07] [V] [TRT] Tactic: 0 time 0.08204
[08/16/2021-04:54:07] [V] [TRT] Fastest Tactic: 0 Time: 0.08204
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:07] [V] [TRT] Tactic: 1002 time 0.256484
[08/16/2021-04:54:07] [V] [TRT] Tactic: 0 time 0.058648
[08/16/2021-04:54:07] [V] [TRT] Fastest Tactic: 0 Time: 0.058648
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:07] [V] [TRT] Tactic: 1002 time 0.151564
[08/16/2021-04:54:07] [V] [TRT] Tactic: 0 time 0.057088
[08/16/2021-04:54:07] [V] [TRT] Fastest Tactic: 0 Time: 0.057088
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:07] [V] [TRT] Tactic: 1002 time 0.154944
[08/16/2021-04:54:07] [V] [TRT] Tactic: 0 time 0.073736
[08/16/2021-04:54:07] [V] [TRT] Fastest Tactic: 0 Time: 0.073736
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:07] [V] [TRT] Tactic: 1002 time 0.15438
[08/16/2021-04:54:07] [V] [TRT] Tactic: 0 time 0.050488
[08/16/2021-04:54:07] [V] [TRT] Fastest Tactic: 0 Time: 0.050488
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:07] [V] [TRT] Tactic: 1002 time 0.222748
[08/16/2021-04:54:07] [V] [TRT] Tactic: 0 time 0.050252
[08/16/2021-04:54:07] [V] [TRT] Fastest Tactic: 0 Time: 0.050252
[08/16/2021-04:54:07] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.080272
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.171108
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.080272
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.082816
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.173104
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.082816
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.083824
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.174352
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.083824
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.081676
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.203328
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.081676
[08/16/2021-04:54:08] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144,262144) ***************
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508 (Shuffle)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.051252
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1 time 0.138392
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.051252
[08/16/2021-04:54:08] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192,8192) ***************
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508 (Shuffle)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.204552
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1 time 0.201596
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 1 Time: 0.201596
[08/16/2021-04:54:08] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144) -> Half(1,32,1024,262144,262144) ***************
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508 (Shuffle)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.027704
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1 time 0.121448
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.027704
[08/16/2021-04:54:08] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072) -> Half(1,32,1024:2,131072,131072) ***************
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508 (Shuffle)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.029348
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1 time 0.244104
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.029348
[08/16/2021-04:54:08] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Half(32,1024,1:8,32768,32768) ***************
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508 (Shuffle)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.09616
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1 time 0.16034
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.09616
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.080864
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.171208
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.080864
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.061872
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.063608
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.061872
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.109548
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.039444
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.039444
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.080572
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.039616
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.039616
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.126496
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.067268
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.067268
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.124904
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.063348
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.063348
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.113724
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.067008
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.067008
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.082724
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.060512
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.060512
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.06952
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.058592
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.058592
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.082332
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.172608
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.082332
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.108544
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.03334
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.03334
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.08052
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.032708
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.032708
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.135112
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.043532
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.043532
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.080676
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.173644
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.080676
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.134764
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.032316
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.032316
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.080448
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.032092
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.032092
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.082048
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.038748
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.038748
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.080904
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.203328
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.080904
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.080304
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.028036
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.028036
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.117556
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.027908
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.027908
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.075364
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.051084
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.051084
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.092372
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.170212
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.092372
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.070168
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.044664
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.044664
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.113516
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.05726
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.05726
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.093124
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.229004
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.093124
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.139308
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.066804
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.066804
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.093768
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.050588
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.050588
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.139272
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.06534
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.06534
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.118152
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.072092
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.072092
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.09262
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.185132
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.09262
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.074264
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.044892
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.044892
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.092508
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.170816
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.092508
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.070044
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.027488
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.027488
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.116912
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.053544
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.053544
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.092956
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.192312
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.092956
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.144652
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.057864
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.057864
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.093116
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.171352
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.093116
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.144896
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.054468
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.054468
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.114328
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.027648
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.027648
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.09298
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.11162
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.09298
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.093748
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.068536
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.068536
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.091988
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.201464
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.091988
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.093196
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.064408
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.064408
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.121032
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.037916
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.037916
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.151164
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.09604
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.09604
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.075388
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.050776
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.050776
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.093736
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.170948
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.093736
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.070388
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.043132
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.043132
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.114472
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.05744
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 0 Time: 0.05744
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.0931
[08/16/2021-04:54:08] [V] [TRT] Tactic: 0 time 0.229836
[08/16/2021-04:54:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0931
[08/16/2021-04:54:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:08] [V] [TRT] Tactic: 1002 time 0.13988
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.066296
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.066296
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.094824
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.050796
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.050796
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.13908
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.065432
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.065432
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.1177
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.073604
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.073604
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.092712
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.185408
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.092712
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.074592
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.04494
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.04494
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.093932
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.170324
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.093932
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.068896
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.027488
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.027488
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.11622
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.053388
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.053388
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.093188
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.193736
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.093188
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.146364
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.057552
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.057552
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.093012
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.170892
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.093012
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.143868
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.054252
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.054252
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.114588
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.027572
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.027572
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.092968
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.111888
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.092968
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.093164
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.068224
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.068224
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.0918
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.201564
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0918
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.093456
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.064128
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.064128
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.11942
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.03792
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.03792
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508:0 copy (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.1517
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.096296
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.096296
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.155328
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.333936
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.155328
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.117252
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.117044
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.117044
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.20664
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.073416
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.073416
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.15326
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.0738
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0738
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.246096
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.126868
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.126868
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.2456
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.119868
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.119868
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.21864
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.126312
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.126312
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.157844
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.113572
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.113572
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.130632
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.110604
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.110604
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.156512
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.333768
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.156512
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.205588
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.060032
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.060032
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.154544
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.056484
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.056484
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.252728
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.082112
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.082112
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.153964
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.33368
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.153964
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.257704
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.05914
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.05914
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.152484
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.056512
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.056512
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.156264
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.073204
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.073204
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.156068
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.396504
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.156068
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.154592
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.049856
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.049856
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.226196
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.050172
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.050172
[08/16/2021-04:54:09] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144,524288) -> Float(1,32,32,1024,262144,524288) ***************
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512 (Shuffle)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.095732
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1 time 0.27526
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.095732
[08/16/2021-04:54:09] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192,16384) -> Float(1,32,32:32,32,8192,16384) ***************
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512 (Shuffle)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.391544
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1 time 0.446652
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.391544
[08/16/2021-04:54:09] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144,524288) -> Half(1,32,32,1024,262144,524288) ***************
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512 (Shuffle)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.050188
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1 time 0.242048
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.050188
[08/16/2021-04:54:09] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072,262144) -> Half(1,32,32:2,512,131072,262144) ***************
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512 (Shuffle)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.146736
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1 time 0.46854
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.146736
[08/16/2021-04:54:09] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768,65536) -> Half(4,128,1:8,128,32768,65536) ***************
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512 (Shuffle)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.14902
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1 time 0.35542
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.14902
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.178976
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.331484
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.178976
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.132728
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.116656
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.116656
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.218392
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.074056
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.074056
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.178848
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.073732
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.073732
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 1.30734
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.102508
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.102508
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 1.30516
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.097212
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.097212
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.226608
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.113452
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.113452
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.159012
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.113496
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.113496
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.141792
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.110756
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.110756
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.179368
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.330064
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.179368
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.216208
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.060152
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.060152
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:09] [V] [TRT] Tactic: 1002 time 0.178444
[08/16/2021-04:54:09] [V] [TRT] Tactic: 0 time 0.071648
[08/16/2021-04:54:09] [V] [TRT] Fastest Tactic: 0 Time: 0.071648
[08/16/2021-04:54:09] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 1.3347
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.080192
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.080192
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.177068
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.329948
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.177068
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 1.33565
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.058396
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.058396
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.179268
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.052844
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.052844
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.179436
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.072524
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.072524
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.144092
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.338172
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.144092
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.179776
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.051692
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.051692
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.209928
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.050968
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.050968
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.622012
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.095188
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.095188
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.1792
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.331464
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.1792
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.632368
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.079052
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.079052
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.215412
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.090988
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.090988
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.178896
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.100208
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.100208
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 1.3069
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.101264
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.101264
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.182976
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.350012
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.182976
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 1.30665
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.097112
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.097112
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.223536
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.113924
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.113924
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.182352
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.1138
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.1138
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.630088
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.080936
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.080936
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.17786
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.330416
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.17786
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.639036
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.073076
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.073076
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.217676
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.084056
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.084056
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.178908
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.088008
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.088008
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 1.3336
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.093288
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.093288
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.178768
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.330224
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.178768
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 1.30775
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.085224
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.085224
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.212312
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.050712
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.050712
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.177864
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.104964
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.104964
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.17986
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.09406
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.09406
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.170256
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.33856
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.170256
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.179036
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.085844
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.085844
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.209772
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.1044
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.1044
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 1.34092
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.049904
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.049904
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.621816
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.095728
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.095728
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.179552
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.331336
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.179552
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.6329
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.079476
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.079476
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.215556
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.09032
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.09032
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.18018
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.099772
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.099772
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 1.30556
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.100868
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.100868
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.181484
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.350608
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.181484
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 1.30765
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.097264
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.097264
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.224892
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.113656
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.113656
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.18134
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.113428
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.113428
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.630128
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.080604
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 0 Time: 0.080604
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:10] [V] [TRT] Tactic: 1002 time 0.178276
[08/16/2021-04:54:10] [V] [TRT] Tactic: 0 time 0.329852
[08/16/2021-04:54:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.178276
[08/16/2021-04:54:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.641784
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.073064
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.073064
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.215968
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.08436
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.08436
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.179916
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.087692
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.087692
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 1.33215
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.093076
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.093076
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.179164
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.330468
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.179164
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 1.33566
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.085292
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.085292
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.21426
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.05152
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.05152
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.177468
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.105424
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.105424
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.178676
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.094332
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.094332
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.171164
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.338676
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.171164
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.179404
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.08596
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.08596
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.210616
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.104872
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.104872
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_1_Unsqueeze__512:0 copy (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 1.20034
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.04992
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.04992
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.299032
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.654768
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.299032
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.224388
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.22264
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.22264
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.392428
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.14048
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.14048
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.297944
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.135492
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.135492
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 1.15502
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.215952
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.215952
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 1.15712
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.192668
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.192668
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.414504
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.220824
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.220824
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.258004
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.219868
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.219868
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.25822
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.214024
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.214024
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.300836
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.652816
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.300836
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.388364
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.114436
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.114436
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.29876
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.0945
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0945
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 1.15591
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.155844
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.155844
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.297188
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.652708
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.297188
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 1.1561
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.110408
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.110408
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.296392
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.09602
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.09602
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.297252
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.137788
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.137788
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.22282
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.679
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.22282
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.295564
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.092904
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.092904
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.38286
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.094276
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.094276
[08/16/2021-04:54:11] [V] [TRT] *************** Autotuning format combination: Float(1,32,64,2048,524288,1048576) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: Transpose__786 + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape + Transpose__732 (Shuffle)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.21462
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1 time 0.392284
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.21462
[08/16/2021-04:54:11] [V] [TRT] *************** Autotuning format combination: Float(1,32,64:32,64,16384,32768) -> Float(1,64,4096:32,32768) ***************
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: Transpose__786 + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape + Transpose__732 (Shuffle)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.85284
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1 time 0.700096
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 1 Time: 0.700096
[08/16/2021-04:54:11] [V] [TRT] *************** Autotuning format combination: Half(1,32,64,2048,524288,1048576) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: Transpose__786 + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape + Transpose__732 (Shuffle)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.209568
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1 time 0.323216
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.209568
[08/16/2021-04:54:11] [V] [TRT] *************** Autotuning format combination: Half(1,32,64:2,1024,262144,524288) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: Transpose__786 + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape + Transpose__732 (Shuffle)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.287704
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1 time 0.841972
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.287704
[08/16/2021-04:54:11] [V] [TRT] *************** Autotuning format combination: Half(4,128,1:8,256,65536,131072) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: Transpose__786 + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape + Transpose__732 (Shuffle)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.85548
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1 time 0.803056
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 1 Time: 0.803056
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:11] [V] [TRT] Tactic: 1002 time 0.518464
[08/16/2021-04:54:11] [V] [TRT] Tactic: 0 time 0.354828
[08/16/2021-04:54:11] [V] [TRT] Fastest Tactic: 0 Time: 0.354828
[08/16/2021-04:54:11] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:12] [V] [TRT] Tactic: 1002 time 0.513024
[08/16/2021-04:54:12] [V] [TRT] Tactic: 0 time 0.308256
[08/16/2021-04:54:12] [V] [TRT] Fastest Tactic: 0 Time: 0.308256
[08/16/2021-04:54:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:12] [V] [TRT] Tactic: 1002 time 0.418124
[08/16/2021-04:54:12] [V] [TRT] Tactic: 0 time 0.34098
[08/16/2021-04:54:12] [V] [TRT] Fastest Tactic: 0 Time: 0.34098
[08/16/2021-04:54:12] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:12] [V] [TRT] Tactic: 1002 time 0.303876
[08/16/2021-04:54:12] [V] [TRT] Tactic: 0 time 0.220524
[08/16/2021-04:54:12] [V] [TRT] Fastest Tactic: 0 Time: 0.220524
[08/16/2021-04:54:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,4194304), Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:54:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (CaskConvolution)
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:54:12] [V] [TRT] Tactic: 1754569683116234317 time 2.9084
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:54:12] [V] [TRT] Tactic: 1825138533642645384 time 2.94834
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:54:12] [V] [TRT] Tactic: 2733356012094739613 time 3.2339
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:54:12] [V] [TRT] Tactic: 3915320020053085238 time 2.97074
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:12] [V] [TRT] Tactic: 6808617066150061604 time 2.84628
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:54:12] [V] [TRT] Tactic: 9091006216302412844 time 2.92341
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:54:12] [V] [TRT] Tactic: -8060443123034038864 time 2.8729
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:54:12] [V] [TRT] Tactic: -4420849921117327522 time 3.60058
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:54:12] [V] [TRT] Tactic: -3946921629105938337 time 3.37052
[08/16/2021-04:54:12] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 2.84628
[08/16/2021-04:54:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (CudaConvolution)
[08/16/2021-04:54:12] [V] [TRT] Tactic: 0 time 4.47446
[08/16/2021-04:54:12] [V] [TRT] Tactic: 2 time 4.81257
[08/16/2021-04:54:12] [V] [TRT] Tactic: 5 skipped. Scratch requested: 57933824, available: 16777216
[08/16/2021-04:54:12] [V] [TRT] Tactic: 57 time 4.59313
[08/16/2021-04:54:12] [V] [TRT] Fastest Tactic: 0 Time: 4.47446
[08/16/2021-04:54:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6808617066150061604
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:12] [V] [TRT] 
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:54:12] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:12] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,4194304), Half(1,64,4096,1048576) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:54:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (CaskConvolution)
[08/16/2021-04:54:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (CudaConvolution)
[08/16/2021-04:54:12] [V] [TRT] Tactic: 0 time 4.48505
[08/16/2021-04:54:13] [V] [TRT] Tactic: 1 time 3.54227
[08/16/2021-04:54:13] [V] [TRT] Tactic: 2 time 4.37955
[08/16/2021-04:54:13] [V] [TRT] Tactic: 4 skipped. Scratch requested: 8894021632, available: 16777216
[08/16/2021-04:54:13] [V] [TRT] Tactic: 5 skipped. Scratch requested: 57933824, available: 16777216
[08/16/2021-04:54:13] [V] [TRT] Fastest Tactic: 1 Time: 3.54227
[08/16/2021-04:54:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:54:13] [V] [TRT] 
[08/16/2021-04:54:13] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,2097152), Half(1,64,4096:2,524288) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (CaskConvolution)
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: 2418518597804310654 time 1.52864
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: 8292881859266835088 time 1.71812
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: 8401509141903434922 time 1.5221
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: -8654297089785671176 time 1.45042
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: -7140760933967189247 time 1.44636
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: -4097850214384059472 time 1.61861
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: -3689982367035295496 time 1.53986
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: -2534402059426524406 time 1.45206
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: -2027588946874785071 time 1.66517
[08/16/2021-04:54:13] [V] [TRT] Fastest Tactic: -7140760933967189247 Time: 1.44636
[08/16/2021-04:54:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (CudaConvolution)
[08/16/2021-04:54:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7140760933967189247
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:54:13] [V] [TRT] 
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:54:13] [V] [TRT] *************** Autotuning format combination: Half(128,8192,1:8,524288), Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:54:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (CaskConvolution)
[08/16/2021-04:54:13] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (CudaConvolution)
[08/16/2021-04:54:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:13] [V] [TRT] *************** Autotuning format combination: Half(128,8192,1:8,524288), Half(32,2048,1:8,131072) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (CaskConvolution)
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: 2105695814191699972 time 0.59824
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: 3754069740140581927 time 0.54478
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: 5666160310350604399 time 0.541684
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: 5925270497649423688 time 0.526744
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: 6680916730816870145 time 0.61272
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: 7158029511300006471 time 0.59772
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: 7859952145590271433 time 0.617476
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: 8283847742354150423 time 0.540888
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: -8391760416076885205 time 0.53916
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: -4534876761957424274 time 0.540316
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: -3237051169894153788 time 0.589124
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] Tactic: -2422160065350346448 time 0.595728
[08/16/2021-04:54:13] [V] [TRT] Fastest Tactic: 5925270497649423688 Time: 0.526744
[08/16/2021-04:54:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (CudaConvolution)
[08/16/2021-04:54:13] [V] [TRT] Tactic: 0 time 4.41568
[08/16/2021-04:54:13] [V] [TRT] Tactic: 1 time 4.59796
[08/16/2021-04:54:13] [V] [TRT] Tactic: 2 time 8.82765
[08/16/2021-04:54:13] [V] [TRT] Fastest Tactic: 0 Time: 4.41568
[08/16/2021-04:54:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5925270497649423688
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] 
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:13] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:13] [V] [TRT] Tactic: 1002 time 0.06754
[08/16/2021-04:54:13] [V] [TRT] Tactic: 0 time 0.043212
[08/16/2021-04:54:13] [V] [TRT] Fastest Tactic: 0 Time: 0.043212
[08/16/2021-04:54:13] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:13] [V] [TRT] Tactic: 1002 time 0.109836
[08/16/2021-04:54:13] [V] [TRT] Tactic: 0 time 0.049312
[08/16/2021-04:54:13] [V] [TRT] Fastest Tactic: 0 Time: 0.049312
[08/16/2021-04:54:13] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:14] [V] [TRT] Tactic: 1002 time 0.0797
[08/16/2021-04:54:14] [V] [TRT] Tactic: 0 time 0.063172
[08/16/2021-04:54:14] [V] [TRT] Fastest Tactic: 0 Time: 0.063172
[08/16/2021-04:54:14] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:14] [V] [TRT] Tactic: 1002 time 0.072028
[08/16/2021-04:54:14] [V] [TRT] Tactic: 0 time 0.05814
[08/16/2021-04:54:14] [V] [TRT] Fastest Tactic: 0 Time: 0.05814
[08/16/2021-04:54:14] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:14] [V] [TRT] Tactic: 1002 time 0.110088
[08/16/2021-04:54:14] [V] [TRT] Tactic: 0 time 0.033436
[08/16/2021-04:54:14] [V] [TRT] Fastest Tactic: 0 Time: 0.033436
[08/16/2021-04:54:14] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:14] [V] [TRT] Tactic: 1002 time 0.081408
[08/16/2021-04:54:14] [V] [TRT] Tactic: 0 time 0.032404
[08/16/2021-04:54:14] [V] [TRT] Fastest Tactic: 0 Time: 0.032404
[08/16/2021-04:54:14] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:14] [V] [TRT] Tactic: 1002 time 0.133772
[08/16/2021-04:54:14] [V] [TRT] Tactic: 0 time 0.043992
[08/16/2021-04:54:14] [V] [TRT] Fastest Tactic: 0 Time: 0.043992
[08/16/2021-04:54:14] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:14] [V] [TRT] Tactic: 1002 time 0.134912
[08/16/2021-04:54:14] [V] [TRT] Tactic: 0 time 0.046124
[08/16/2021-04:54:14] [V] [TRT] Fastest Tactic: 0 Time: 0.046124
[08/16/2021-04:54:14] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:14] [V] [TRT] Tactic: 1002 time 0.079256
[08/16/2021-04:54:14] [V] [TRT] Tactic: 0 time 0.032184
[08/16/2021-04:54:14] [V] [TRT] Fastest Tactic: 0 Time: 0.032184
[08/16/2021-04:54:14] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:14] [V] [TRT] Tactic: 1002 time 0.0811
[08/16/2021-04:54:14] [V] [TRT] Tactic: 0 time 0.039032
[08/16/2021-04:54:14] [V] [TRT] Fastest Tactic: 0 Time: 0.039032
[08/16/2021-04:54:14] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:14] [V] [TRT] Tactic: 1002 time 0.0804
[08/16/2021-04:54:14] [V] [TRT] Tactic: 0 time 0.0277
[08/16/2021-04:54:14] [V] [TRT] Fastest Tactic: 0 Time: 0.0277
[08/16/2021-04:54:14] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:14] [V] [TRT] Tactic: 1002 time 0.11806
[08/16/2021-04:54:14] [V] [TRT] Tactic: 0 time 0.028044
[08/16/2021-04:54:14] [V] [TRT] Fastest Tactic: 0 Time: 0.028044
[08/16/2021-04:54:14] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,262144) ***************
[08/16/2021-04:54:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:54:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:54:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:54:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:54:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:54:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:54:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:54:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:14] [V] [TRT] Tactic: 524287 time 1.8849
[08/16/2021-04:54:14] [V] [TRT] Tactic: 720895 time 2.05338
[08/16/2021-04:54:14] [V] [TRT] Tactic: 983039 time 1.79336
[08/16/2021-04:54:14] [V] [TRT] Tactic: 1048575 time 1.87452
[08/16/2021-04:54:14] [V] [TRT] Tactic: 1703935 time 1.83357
[08/16/2021-04:54:14] [V] [TRT] Tactic: 1769471 time 2.34984
[08/16/2021-04:54:14] [V] [TRT] Tactic: 1966079 time 1.85516
[08/16/2021-04:54:15] [V] [TRT] Tactic: 2031615 time 2.19664
[08/16/2021-04:54:15] [V] [TRT] Tactic: 2228223 time 1.86428
[08/16/2021-04:54:15] [V] [TRT] Tactic: 2424831 time 1.8683
[08/16/2021-04:54:15] [V] [TRT] Tactic: 2621439 time 1.95418
[08/16/2021-04:54:15] [V] [TRT] Tactic: 2752511 time 1.93269
[08/16/2021-04:54:15] [V] [TRT] Tactic: 2818047 time 2.03779
[08/16/2021-04:54:15] [V] [TRT] Tactic: 2883583 time 1.95142
[08/16/2021-04:54:15] [V] [TRT] Tactic: 3014655 time 1.80359
[08/16/2021-04:54:15] [V] [TRT] Tactic: 3145727 time 1.89556
[08/16/2021-04:54:15] [V] [TRT] Tactic: 3473407 time 1.99381
[08/16/2021-04:54:16] [V] [TRT] Tactic: 3604479 time 1.8085
[08/16/2021-04:54:16] [V] [TRT] Tactic: 3735551 time 2.02061
[08/16/2021-04:54:16] [V] [TRT] Tactic: 4390911 time 1.97338
[08/16/2021-04:54:16] [V] [TRT] Tactic: 5046271 time 1.96572
[08/16/2021-04:54:16] [V] [TRT] Tactic: 5963775 time 1.92762
[08/16/2021-04:54:16] [V] [TRT] Tactic: 6160383 time 1.97807
[08/16/2021-04:54:16] [V] [TRT] Tactic: 6488063 time 2.05608
[08/16/2021-04:54:16] [V] [TRT] Tactic: 6881279 time 1.96378
[08/16/2021-04:54:16] [V] [TRT] Tactic: 7274495 time 2.17964
[08/16/2021-04:54:17] [V] [TRT] Tactic: 7864319 time 2.09476
[08/16/2021-04:54:17] [V] [TRT] Tactic: 7995391 time 1.63054
[08/16/2021-04:54:17] [V] [TRT] Tactic: 8585215 time 1.98743
[08/16/2021-04:54:17] [V] [TRT] Tactic: 8847359 time 2.47067
[08/16/2021-04:54:17] [V] [TRT] Tactic: 8978431 time 1.87788
[08/16/2021-04:54:17] [V] [TRT] Tactic: 9043967 time 1.99469
[08/16/2021-04:54:17] [V] [TRT] Tactic: 9175039 time 1.81341
[08/16/2021-04:54:17] [V] [TRT] Tactic: 9502719 time 2.13603
[08/16/2021-04:54:17] [V] [TRT] Tactic: 9830399 time 1.88247
[08/16/2021-04:54:17] [V] [TRT] Tactic: 9961471 time 2.08569
[08/16/2021-04:54:18] [V] [TRT] Tactic: 10027007 time 1.94695
[08/16/2021-04:54:18] [V] [TRT] Tactic: 10092543 time 1.98196
[08/16/2021-04:54:18] [V] [TRT] Tactic: 10289151 time 1.8554
[08/16/2021-04:54:18] [V] [TRT] Tactic: 10485759 time 2.05662
[08/16/2021-04:54:18] [V] [TRT] Tactic: 10682367 time 1.86132
[08/16/2021-04:54:18] [V] [TRT] Tactic: 10813439 time 1.61663
[08/16/2021-04:54:18] [V] [TRT] Fastest Tactic: 10813439 Time: 1.61663
[08/16/2021-04:54:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (CaskConvolution)
[08/16/2021-04:54:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:54:18] [V] [TRT] Tactic: 1825138533642645384 time 1.65394
[08/16/2021-04:54:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:54:18] [V] [TRT] Tactic: 2842488832350522458 time 1.65337
[08/16/2021-04:54:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:54:18] [V] [TRT] Tactic: 3915320020053085238 time 1.63942
[08/16/2021-04:54:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:54:18] [V] [TRT] Tactic: 6448355332020552203 time 1.69176
[08/16/2021-04:54:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:18] [V] [TRT] Tactic: 6808617066150061604 time 1.71671
[08/16/2021-04:54:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:54:18] [V] [TRT] Tactic: -8060443123034038864 time 1.71051
[08/16/2021-04:54:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:54:18] [V] [TRT] Tactic: -4420849921117327522 time 1.79566
[08/16/2021-04:54:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:54:18] [V] [TRT] Tactic: -3946921629105938337 time 1.99238
[08/16/2021-04:54:18] [V] [TRT] Fastest Tactic: 3915320020053085238 Time: 1.63942
[08/16/2021-04:54:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (CudaConvolution)
[08/16/2021-04:54:18] [V] [TRT] Tactic: 0 time 2.43072
[08/16/2021-04:54:19] [V] [TRT] Tactic: 2 time 2.5268
[08/16/2021-04:54:19] [V] [TRT] Tactic: 5 skipped. Scratch requested: 289669120, available: 16777216
[08/16/2021-04:54:19] [V] [TRT] Tactic: 6 time 1.08518
[08/16/2021-04:54:19] [V] [TRT] Tactic: 57 time 4.16122
[08/16/2021-04:54:19] [V] [TRT] Fastest Tactic: 6 Time: 1.08518
[08/16/2021-04:54:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6
[08/16/2021-04:54:19] [V] [TRT] 
[08/16/2021-04:54:19] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,524288) -> Half(1,32,1024,262144) ***************
[08/16/2021-04:54:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (CaskConvolution)
[08/16/2021-04:54:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (CudaConvolution)
[08/16/2021-04:54:19] [V] [TRT] Tactic: 0 time 2.62012
[08/16/2021-04:54:19] [V] [TRT] Tactic: 1 time 3.05618
[08/16/2021-04:54:19] [V] [TRT] Tactic: 2 time 2.27974
[08/16/2021-04:54:19] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2225602560, available: 16777216
[08/16/2021-04:54:19] [V] [TRT] Tactic: 5 skipped. Scratch requested: 289669120, available: 16777216
[08/16/2021-04:54:19] [V] [TRT] Tactic: 6 time 2.78136
[08/16/2021-04:54:19] [V] [TRT] Fastest Tactic: 2 Time: 2.27974
[08/16/2021-04:54:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2
[08/16/2021-04:54:19] [V] [TRT] 
[08/16/2021-04:54:19] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,262144) -> Half(1,32,1024:2,131072) ***************
[08/16/2021-04:54:19] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:54:19] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:19] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:19] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:19] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:19] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:54:19] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:19] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:19] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:54:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:19] [V] [TRT] Tactic: 524287 time 0.944952
[08/16/2021-04:54:19] [V] [TRT] Tactic: 720895 time 1.03092
[08/16/2021-04:54:19] [V] [TRT] Tactic: 983039 time 0.933368
[08/16/2021-04:54:19] [V] [TRT] Tactic: 1048575 time 0.933008
[08/16/2021-04:54:19] [V] [TRT] Tactic: 1703935 time 0.906084
[08/16/2021-04:54:19] [V] [TRT] Tactic: 1769471 time 1.1765
[08/16/2021-04:54:19] [V] [TRT] Tactic: 1966079 time 0.914664
[08/16/2021-04:54:19] [V] [TRT] Tactic: 2031615 time 1.10094
[08/16/2021-04:54:19] [V] [TRT] Tactic: 2228223 time 0.942988
[08/16/2021-04:54:19] [V] [TRT] Tactic: 2424831 time 0.94974
[08/16/2021-04:54:20] [V] [TRT] Tactic: 2621439 time 0.992528
[08/16/2021-04:54:20] [V] [TRT] Tactic: 2752511 time 1.08015
[08/16/2021-04:54:20] [V] [TRT] Tactic: 2818047 time 1.01696
[08/16/2021-04:54:20] [V] [TRT] Tactic: 2883583 time 0.961584
[08/16/2021-04:54:20] [V] [TRT] Tactic: 3014655 time 0.88518
[08/16/2021-04:54:20] [V] [TRT] Tactic: 3145727 time 0.987256
[08/16/2021-04:54:20] [V] [TRT] Tactic: 3473407 time 0.976116
[08/16/2021-04:54:20] [V] [TRT] Tactic: 3604479 time 0.885936
[08/16/2021-04:54:20] [V] [TRT] Tactic: 3735551 time 1.01978
[08/16/2021-04:54:20] [V] [TRT] Tactic: 4390911 time 0.997696
[08/16/2021-04:54:20] [V] [TRT] Tactic: 5046271 time 1.11123
[08/16/2021-04:54:20] [V] [TRT] Tactic: 5963775 time 1.02063
[08/16/2021-04:54:20] [V] [TRT] Tactic: 6160383 time 0.952516
[08/16/2021-04:54:20] [V] [TRT] Tactic: 6488063 time 1.04737
[08/16/2021-04:54:20] [V] [TRT] Tactic: 6881279 time 1.00309
[08/16/2021-04:54:20] [V] [TRT] Tactic: 7274495 time 1.08725
[08/16/2021-04:54:20] [V] [TRT] Tactic: 7864319 time 1.0964
[08/16/2021-04:54:21] [V] [TRT] Tactic: 7995391 time 0.88836
[08/16/2021-04:54:21] [V] [TRT] Tactic: 8585215 time 1.00342
[08/16/2021-04:54:21] [V] [TRT] Tactic: 8847359 time 1.28421
[08/16/2021-04:54:21] [V] [TRT] Tactic: 8978431 time 1.02526
[08/16/2021-04:54:21] [V] [TRT] Tactic: 9043967 time 0.989796
[08/16/2021-04:54:21] [V] [TRT] Tactic: 9175039 time 0.8849
[08/16/2021-04:54:21] [V] [TRT] Tactic: 9502719 time 0.988884
[08/16/2021-04:54:21] [V] [TRT] Tactic: 9830399 time 0.945256
[08/16/2021-04:54:21] [V] [TRT] Tactic: 9961471 time 1.07063
[08/16/2021-04:54:21] [V] [TRT] Tactic: 10027007 time 0.991604
[08/16/2021-04:54:21] [V] [TRT] Tactic: 10092543 time 0.99526
[08/16/2021-04:54:21] [V] [TRT] Tactic: 10289151 time 0.916892
[08/16/2021-04:54:21] [V] [TRT] Tactic: 10485759 time 1.10331
[08/16/2021-04:54:21] [V] [TRT] Tactic: 10682367 time 0.9854
[08/16/2021-04:54:21] [V] [TRT] Tactic: 10813439 time 0.848196
[08/16/2021-04:54:21] [V] [TRT] Fastest Tactic: 10813439 Time: 0.848196
[08/16/2021-04:54:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (CaskConvolution)
[08/16/2021-04:54:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:54:21] [V] [TRT] Tactic: 1145226902788474763 time 0.881628
[08/16/2021-04:54:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:21] [V] [TRT] Tactic: 2418518597804310654 time 0.877256
[08/16/2021-04:54:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:21] [V] [TRT] Tactic: 8292881859266835088 time 0.897268
[08/16/2021-04:54:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:21] [V] [TRT] Tactic: 8401509141903434922 time 0.856556
[08/16/2021-04:54:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: -8654297089785671176 time 0.847704
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: -7448936905981214224 time 0.914888
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: -3689982367035295496 time 0.984904
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: -2027588946874785071 time 0.878916
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: -245090590808296743 time 0.87334
[08/16/2021-04:54:22] [V] [TRT] Fastest Tactic: -8654297089785671176 Time: 0.847704
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (CudaConvolution)
[08/16/2021-04:54:22] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8654297089785671176
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:22] [V] [TRT] 
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:22] [V] [TRT] *************** Autotuning format combination: Half(64,2048,1:8,65536) -> Float(1,32,1024,262144) ***************
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (CaskConvolution)
[08/16/2021-04:54:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (CudaConvolution)
[08/16/2021-04:54:22] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:22] [V] [TRT] *************** Autotuning format combination: Half(64,2048,1:8,65536) -> Half(32,1024,1:8,32768) ***************
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (CaskConvolution)
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: 3754069740140581927 time 0.307808
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: 5925270497649423688 time 0.320548
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: 6680916730816870145 time 0.292028
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: 7158029511300006471 time 0.306656
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: 7859952145590271433 time 0.293012
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: 8283847742354150423 time 0.302288
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: -4534876761957424274 time 0.330028
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: -3237051169894153788 time 0.302776
[08/16/2021-04:54:22] [V] [TRT] Fastest Tactic: 6680916730816870145 Time: 0.292028
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (CudaConvolution)
[08/16/2021-04:54:22] [V] [TRT] Tactic: 0 time 4.82485
[08/16/2021-04:54:22] [V] [TRT] Tactic: 1 time 5.29728
[08/16/2021-04:54:22] [V] [TRT] Tactic: 2 time 2.58296
[08/16/2021-04:54:22] [V] [TRT] Tactic: 6 time 2.90896
[08/16/2021-04:54:22] [V] [TRT] Fastest Tactic: 2 Time: 2.58296
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6680916730816870145
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] 
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:22] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,262144) ***************
[08/16/2021-04:54:22] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,524288) -> Half(1,32,1024,262144) ***************
[08/16/2021-04:54:22] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,262144) -> Half(1,32,1024:2,131072) ***************
[08/16/2021-04:54:22] [V] [TRT] *************** Autotuning format combination: Half(64,2048,1:8,65536) -> Float(1,32,1024,262144) ***************
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_2/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_2/Relu6 (CaskConvolution)
[08/16/2021-04:54:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_2/Relu6 (CudaConvolution)
[08/16/2021-04:54:22] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_2/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:22] [V] [TRT] *************** Autotuning format combination: Half(64,2048,1:8,65536) -> Half(32,1024,1:8,32768) ***************
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:22] [V] [TRT] Tactic: 1002 time 0.011528
[08/16/2021-04:54:22] [V] [TRT] Tactic: 0 time 0.018988
[08/16/2021-04:54:22] [V] [TRT] Fastest Tactic: 1002 Time: 0.011528
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:22] [V] [TRT] Tactic: 1002 time 0.03278
[08/16/2021-04:54:22] [V] [TRT] Tactic: 0 time 0.011572
[08/16/2021-04:54:22] [V] [TRT] Fastest Tactic: 0 Time: 0.011572
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:22] [V] [TRT] Tactic: 1002 time 0.023188
[08/16/2021-04:54:22] [V] [TRT] Tactic: 0 time 0.011524
[08/16/2021-04:54:22] [V] [TRT] Fastest Tactic: 0 Time: 0.011524
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:22] [V] [TRT] Tactic: 1002 time 0.01132
[08/16/2021-04:54:22] [V] [TRT] Tactic: 0 time 0.0183
[08/16/2021-04:54:22] [V] [TRT] Fastest Tactic: 1002 Time: 0.01132
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:22] [V] [TRT] Tactic: 1002 time 0.032048
[08/16/2021-04:54:22] [V] [TRT] Tactic: 0 time 0.011552
[08/16/2021-04:54:22] [V] [TRT] Fastest Tactic: 0 Time: 0.011552
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:22] [V] [TRT] Tactic: 1002 time 0.023292
[08/16/2021-04:54:22] [V] [TRT] Tactic: 0 time 0.011416
[08/16/2021-04:54:22] [V] [TRT] Fastest Tactic: 0 Time: 0.011416
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:22] [V] [TRT] Tactic: 1002 time 0.03514
[08/16/2021-04:54:22] [V] [TRT] Tactic: 0 time 0.010104
[08/16/2021-04:54:22] [V] [TRT] Fastest Tactic: 0 Time: 0.010104
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:22] [V] [TRT] Tactic: 1002 time 0.035448
[08/16/2021-04:54:22] [V] [TRT] Tactic: 0 time 0.009668
[08/16/2021-04:54:22] [V] [TRT] Fastest Tactic: 0 Time: 0.009668
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:22] [V] [TRT] Tactic: 1002 time 0.023196
[08/16/2021-04:54:22] [V] [TRT] Tactic: 0 time 0.007568
[08/16/2021-04:54:22] [V] [TRT] Fastest Tactic: 0 Time: 0.007568
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:22] [V] [TRT] Tactic: 1002 time 0.0222
[08/16/2021-04:54:22] [V] [TRT] Tactic: 0 time 0.011176
[08/16/2021-04:54:22] [V] [TRT] Fastest Tactic: 0 Time: 0.011176
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:22] [V] [TRT] Tactic: 1002 time 0.023388
[08/16/2021-04:54:22] [V] [TRT] Tactic: 0 time 0.009232
[08/16/2021-04:54:22] [V] [TRT] Fastest Tactic: 0 Time: 0.009232
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:22] [V] [TRT] Tactic: 1002 time 0.034992
[08/16/2021-04:54:22] [V] [TRT] Tactic: 0 time 0.007508
[08/16/2021-04:54:22] [V] [TRT] Fastest Tactic: 0 Time: 0.007508
[08/16/2021-04:54:22] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,65536) -> Float(1,8,64,16384) ***************
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (CaskConvolution)
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: 1825138533642645384 time 0.556992
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: 2842488832350522458 time 0.432656
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: 3915320020053085238 time 0.553696
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: 6448355332020552203 time 0.56048
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: 6808617066150061604 time 0.3927
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: -8060443123034038864 time 0.43286
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: -4420849921117327522 time 0.516608
[08/16/2021-04:54:22] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:54:22] [V] [TRT] Tactic: -3946921629105938337 time 0.607884
[08/16/2021-04:54:22] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.3927
[08/16/2021-04:54:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (CudaConvolution)
[08/16/2021-04:54:22] [V] [TRT] Tactic: 0 time 0.3281
[08/16/2021-04:54:23] [V] [TRT] Tactic: 2 time 0.390068
[08/16/2021-04:54:23] [V] [TRT] Tactic: 5 skipped. Scratch requested: 287736832, available: 16777216
[08/16/2021-04:54:23] [V] [TRT] Tactic: 57 time 0.91676
[08/16/2021-04:54:23] [V] [TRT] Fastest Tactic: 0 Time: 0.3281
[08/16/2021-04:54:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0
[08/16/2021-04:54:23] [V] [TRT] 
[08/16/2021-04:54:23] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,65536) -> Half(1,8,64,16384) ***************
[08/16/2021-04:54:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (CaskConvolution)
[08/16/2021-04:54:23] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (CudaConvolution)
[08/16/2021-04:54:23] [V] [TRT] Tactic: 0 time 0.370272
[08/16/2021-04:54:23] [V] [TRT] Tactic: 1 time 0.74014
[08/16/2021-04:54:23] [V] [TRT] Tactic: 2 time 0.319156
[08/16/2021-04:54:23] [V] [TRT] Tactic: 5 skipped. Scratch requested: 287588864, available: 16777216
[08/16/2021-04:54:23] [V] [TRT] Fastest Tactic: 2 Time: 0.319156
[08/16/2021-04:54:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2
[08/16/2021-04:54:23] [V] [TRT] 
[08/16/2021-04:54:23] [V] [TRT] *************** Autotuning format combination: Half(1,16,256:2,32768) -> Half(1,8,64:2,8192) ***************
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:54:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (CaskConvolution)
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:54:23] [V] [TRT] Tactic: 1145226902788474763 time 0.221472
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:23] [V] [TRT] Tactic: 2418518597804310654 time 0.217204
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:23] [V] [TRT] Tactic: 8292881859266835088 time 0.258488
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:23] [V] [TRT] Tactic: 8401509141903434922 time 0.193788
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:23] [V] [TRT] Tactic: -8654297089785671176 time 0.285948
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:54:23] [V] [TRT] Tactic: -7448936905981214224 time 0.35224
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:23] [V] [TRT] Tactic: -3689982367035295496 time 0.285436
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:23] [V] [TRT] Tactic: -2027588946874785071 time 0.221676
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:54:23] [V] [TRT] Tactic: -245090590808296743 time 0.292228
[08/16/2021-04:54:23] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 0.193788
[08/16/2021-04:54:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (CudaConvolution)
[08/16/2021-04:54:23] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:23] [V] [TRT] 
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:23] [V] [TRT] *************** Autotuning format combination: Half(32,512,1:8,8192) -> Float(1,8,64,16384) ***************
[08/16/2021-04:54:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (CaskConvolution)
[08/16/2021-04:54:23] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (CudaConvolution)
[08/16/2021-04:54:23] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:23] [V] [TRT] *************** Autotuning format combination: Half(32,512,1:8,8192) -> Half(32,256,1:8,2048) ***************
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (CaskConvolution)
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] Tactic: 3754069740140581927 time 0.121068
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] Tactic: 5925270497649423688 time 0.154036
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] Tactic: 6680916730816870145 time 0.093516
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] Tactic: 7158029511300006471 time 0.10512
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] Tactic: 7859952145590271433 time 0.09388
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] Tactic: 8283847742354150423 time 0.120612
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] Tactic: -4534876761957424274 time 0.15448
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] Tactic: -3237051169894153788 time 0.103188
[08/16/2021-04:54:23] [V] [TRT] Fastest Tactic: 6680916730816870145 Time: 0.093516
[08/16/2021-04:54:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (CudaConvolution)
[08/16/2021-04:54:23] [V] [TRT] Tactic: 0 time 0.440484
[08/16/2021-04:54:23] [V] [TRT] Tactic: 1 time 0.837772
[08/16/2021-04:54:23] [V] [TRT] Tactic: 2 time 0.331916
[08/16/2021-04:54:23] [V] [TRT] Fastest Tactic: 2 Time: 0.331916
[08/16/2021-04:54:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6680916730816870145
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] 
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:23] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,65536) -> Float(1,16,256,131072) ***************
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:54:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:54:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:23] [V] [TRT] Tactic: 524287 time 1.25298
[08/16/2021-04:54:23] [V] [TRT] Tactic: 720895 time 1.12799
[08/16/2021-04:54:23] [V] [TRT] Tactic: 983039 time 1.08675
[08/16/2021-04:54:23] [V] [TRT] Tactic: 1048575 time 1.13776
[08/16/2021-04:54:23] [V] [TRT] Tactic: 1703935 time 1.05394
[08/16/2021-04:54:23] [V] [TRT] Tactic: 1769471 time 1.64057
[08/16/2021-04:54:23] [V] [TRT] Tactic: 1966079 time 0.918496
[08/16/2021-04:54:24] [V] [TRT] Tactic: 2031615 time 1.46064
[08/16/2021-04:54:24] [V] [TRT] Tactic: 2228223 time 0.922268
[08/16/2021-04:54:24] [V] [TRT] Tactic: 2424831 time 0.935744
[08/16/2021-04:54:24] [V] [TRT] Tactic: 2621439 time 1.12992
[08/16/2021-04:54:24] [V] [TRT] Tactic: 2752511 time 1.29439
[08/16/2021-04:54:24] [V] [TRT] Tactic: 2818047 time 1.37362
[08/16/2021-04:54:24] [V] [TRT] Tactic: 2883583 time 1.10869
[08/16/2021-04:54:24] [V] [TRT] Tactic: 3014655 time 1.05882
[08/16/2021-04:54:24] [V] [TRT] Tactic: 3145727 time 1.29272
[08/16/2021-04:54:24] [V] [TRT] Tactic: 3473407 time 1.12615
[08/16/2021-04:54:24] [V] [TRT] Tactic: 3604479 time 1.0524
[08/16/2021-04:54:24] [V] [TRT] Tactic: 3735551 time 1.49514
[08/16/2021-04:54:25] [V] [TRT] Tactic: 4390911 time 1.53616
[08/16/2021-04:54:25] [V] [TRT] Tactic: 5046271 time 1.27159
[08/16/2021-04:54:25] [V] [TRT] Tactic: 5963775 time 1.0622
[08/16/2021-04:54:25] [V] [TRT] Tactic: 6160383 time 1.19328
[08/16/2021-04:54:25] [V] [TRT] Tactic: 6488063 time 1.40389
[08/16/2021-04:54:25] [V] [TRT] Tactic: 6881279 time 1.395
[08/16/2021-04:54:25] [V] [TRT] Tactic: 7274495 time 1.6221
[08/16/2021-04:54:25] [V] [TRT] Tactic: 7864319 time 1.25203
[08/16/2021-04:54:25] [V] [TRT] Tactic: 7995391 time 0.927084
[08/16/2021-04:54:25] [V] [TRT] Tactic: 8585215 time 1.46195
[08/16/2021-04:54:25] [V] [TRT] Tactic: 8847359 time 1.73746
[08/16/2021-04:54:26] [V] [TRT] Tactic: 8978431 time 1.05528
[08/16/2021-04:54:26] [V] [TRT] Tactic: 9043967 time 1.40567
[08/16/2021-04:54:26] [V] [TRT] Tactic: 9175039 time 1.05201
[08/16/2021-04:54:26] [V] [TRT] Tactic: 9502719 time 1.29547
[08/16/2021-04:54:26] [V] [TRT] Tactic: 9830399 time 1.10792
[08/16/2021-04:54:26] [V] [TRT] Tactic: 9961471 time 1.23322
[08/16/2021-04:54:26] [V] [TRT] Tactic: 10027007 time 1.36271
[08/16/2021-04:54:26] [V] [TRT] Tactic: 10092543 time 1.54117
[08/16/2021-04:54:26] [V] [TRT] Tactic: 10289151 time 0.918164
[08/16/2021-04:54:26] [V] [TRT] Tactic: 10485759 time 1.37281
[08/16/2021-04:54:26] [V] [TRT] Tactic: 10682367 time 1.06824
[08/16/2021-04:54:26] [V] [TRT] Tactic: 10813439 time 0.832344
[08/16/2021-04:54:26] [V] [TRT] Fastest Tactic: 10813439 Time: 0.832344
[08/16/2021-04:54:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (CaskConvolution)
[08/16/2021-04:54:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:54:26] [V] [TRT] Tactic: 1825138533642645384 time 1.09487
[08/16/2021-04:54:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:54:27] [V] [TRT] Tactic: 2842488832350522458 time 0.840196
[08/16/2021-04:54:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:54:27] [V] [TRT] Tactic: 3915320020053085238 time 1.08726
[08/16/2021-04:54:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:54:27] [V] [TRT] Tactic: 6448355332020552203 time 1.27647
[08/16/2021-04:54:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:27] [V] [TRT] Tactic: 6808617066150061604 time 0.851488
[08/16/2021-04:54:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:54:27] [V] [TRT] Tactic: -8060443123034038864 time 0.871896
[08/16/2021-04:54:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:54:27] [V] [TRT] Tactic: -4420849921117327522 time 1.12838
[08/16/2021-04:54:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:54:27] [V] [TRT] Tactic: -3946921629105938337 time 1.16182
[08/16/2021-04:54:27] [V] [TRT] Fastest Tactic: 2842488832350522458 Time: 0.840196
[08/16/2021-04:54:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (CudaConvolution)
[08/16/2021-04:54:27] [V] [TRT] Tactic: 0 time 1.22836
[08/16/2021-04:54:27] [V] [TRT] Tactic: 2 time 1.18534
[08/16/2021-04:54:27] [V] [TRT] Tactic: 5 skipped. Scratch requested: 573767680, available: 16777216
[08/16/2021-04:54:27] [V] [TRT] Tactic: 6 time 0.834052
[08/16/2021-04:54:27] [V] [TRT] Tactic: 57 time 1.57288
[08/16/2021-04:54:27] [V] [TRT] Fastest Tactic: 6 Time: 0.834052
[08/16/2021-04:54:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:27] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10813439
[08/16/2021-04:54:27] [V] [TRT] 
[08/16/2021-04:54:27] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,65536) -> Half(1,16,256,131072) ***************
[08/16/2021-04:54:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:27] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (CaskConvolution)
[08/16/2021-04:54:27] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (CudaConvolution)
[08/16/2021-04:54:27] [V] [TRT] Tactic: 0 time 1.40247
[08/16/2021-04:54:27] [V] [TRT] Tactic: 1 time 2.66743
[08/16/2021-04:54:27] [V] [TRT] Tactic: 2 time 1.22544
[08/16/2021-04:54:27] [V] [TRT] Tactic: 4 skipped. Scratch requested: 1147797504, available: 16777216
[08/16/2021-04:54:27] [V] [TRT] Tactic: 5 skipped. Scratch requested: 573767680, available: 16777216
[08/16/2021-04:54:27] [V] [TRT] Tactic: 6 skipped. Scratch requested: 18614784, available: 16777216
[08/16/2021-04:54:27] [V] [TRT] Fastest Tactic: 2 Time: 1.22544
[08/16/2021-04:54:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:27] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2
[08/16/2021-04:54:27] [V] [TRT] 
[08/16/2021-04:54:27] [V] [TRT] *************** Autotuning format combination: Half(1,16,256:2,32768) -> Half(1,16,256:2,65536) ***************
[08/16/2021-04:54:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:54:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:54:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:54:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:27] [V] [TRT] Tactic: 524287 time 0.631952
[08/16/2021-04:54:27] [V] [TRT] Tactic: 720895 time 0.624572
[08/16/2021-04:54:27] [V] [TRT] Tactic: 983039 time 0.60728
[08/16/2021-04:54:27] [V] [TRT] Tactic: 1048575 time 0.546752
[08/16/2021-04:54:27] [V] [TRT] Tactic: 1703935 time 0.53208
[08/16/2021-04:54:27] [V] [TRT] Tactic: 1769471 time 0.84522
[08/16/2021-04:54:27] [V] [TRT] Tactic: 1966079 time 0.462732
[08/16/2021-04:54:27] [V] [TRT] Tactic: 2031615 time 0.724908
[08/16/2021-04:54:27] [V] [TRT] Tactic: 2228223 time 0.471292
[08/16/2021-04:54:27] [V] [TRT] Tactic: 2424831 time 0.47922
[08/16/2021-04:54:27] [V] [TRT] Tactic: 2621439 time 0.57986
[08/16/2021-04:54:28] [V] [TRT] Tactic: 2752511 time 0.725308
[08/16/2021-04:54:28] [V] [TRT] Tactic: 2818047 time 0.687388
[08/16/2021-04:54:28] [V] [TRT] Tactic: 2883583 time 0.56362
[08/16/2021-04:54:28] [V] [TRT] Tactic: 3014655 time 0.534176
[08/16/2021-04:54:28] [V] [TRT] Tactic: 3145727 time 0.69568
[08/16/2021-04:54:28] [V] [TRT] Tactic: 3473407 time 0.5665
[08/16/2021-04:54:28] [V] [TRT] Tactic: 3604479 time 0.534416
[08/16/2021-04:54:28] [V] [TRT] Tactic: 3735551 time 0.728192
[08/16/2021-04:54:28] [V] [TRT] Tactic: 4390911 time 0.735948
[08/16/2021-04:54:28] [V] [TRT] Tactic: 5046271 time 0.691352
[08/16/2021-04:54:28] [V] [TRT] Tactic: 5963775 time 0.631044
[08/16/2021-04:54:28] [V] [TRT] Tactic: 6160383 time 0.574308
[08/16/2021-04:54:28] [V] [TRT] Tactic: 6488063 time 0.717208
[08/16/2021-04:54:28] [V] [TRT] Tactic: 6881279 time 0.61002
[08/16/2021-04:54:28] [V] [TRT] Tactic: 7274495 time 0.782868
[08/16/2021-04:54:28] [V] [TRT] Tactic: 7864319 time 0.666784
[08/16/2021-04:54:28] [V] [TRT] Tactic: 7995391 time 0.460096
[08/16/2021-04:54:28] [V] [TRT] Tactic: 8585215 time 0.696828
[08/16/2021-04:54:28] [V] [TRT] Tactic: 8847359 time 0.922748
[08/16/2021-04:54:29] [V] [TRT] Tactic: 8978431 time 0.631404
[08/16/2021-04:54:29] [V] [TRT] Tactic: 9043967 time 0.711076
[08/16/2021-04:54:29] [V] [TRT] Tactic: 9175039 time 0.532284
[08/16/2021-04:54:29] [V] [TRT] Tactic: 9502719 time 0.727692
[08/16/2021-04:54:29] [V] [TRT] Tactic: 9830399 time 0.526176
[08/16/2021-04:54:29] [V] [TRT] Tactic: 9961471 time 0.633832
[08/16/2021-04:54:29] [V] [TRT] Tactic: 10027007 time 0.692156
[08/16/2021-04:54:29] [V] [TRT] Tactic: 10092543 time 0.735668
[08/16/2021-04:54:29] [V] [TRT] Tactic: 10289151 time 0.463428
[08/16/2021-04:54:29] [V] [TRT] Tactic: 10485759 time 0.686656
[08/16/2021-04:54:29] [V] [TRT] Tactic: 10682367 time 0.573244
[08/16/2021-04:54:29] [V] [TRT] Tactic: 10813439 time 0.458228
[08/16/2021-04:54:29] [V] [TRT] Fastest Tactic: 10813439 Time: 0.458228
[08/16/2021-04:54:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (CaskConvolution)
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:54:29] [V] [TRT] Tactic: 1145226902788474763 time 0.451844
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:29] [V] [TRT] Tactic: 2418518597804310654 time 0.448036
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:29] [V] [TRT] Tactic: 8292881859266835088 time 0.464264
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:29] [V] [TRT] Tactic: 8401509141903434922 time 0.43484
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:29] [V] [TRT] Tactic: -8654297089785671176 time 0.566848
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:54:29] [V] [TRT] Tactic: -7448936905981214224 time 0.478504
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:29] [V] [TRT] Tactic: -3689982367035295496 time 0.585552
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:29] [V] [TRT] Tactic: -2027588946874785071 time 0.449016
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:54:29] [V] [TRT] Tactic: -245090590808296743 time 0.592192
[08/16/2021-04:54:29] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 0.43484
[08/16/2021-04:54:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (CudaConvolution)
[08/16/2021-04:54:29] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:29] [V] [TRT] 
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:29] [V] [TRT] *************** Autotuning format combination: Half(32,512,1:8,8192) -> Float(1,16,256,131072) ***************
[08/16/2021-04:54:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (CaskConvolution)
[08/16/2021-04:54:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (CudaConvolution)
[08/16/2021-04:54:29] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:29] [V] [TRT] *************** Autotuning format combination: Half(32,512,1:8,8192) -> Half(64,1024,1:8,16384) ***************
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (CaskConvolution)
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:29] [V] [TRT] Tactic: 3754069740140581927 time 0.183064
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:29] [V] [TRT] Tactic: 5925270497649423688 time 0.166836
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:29] [V] [TRT] Tactic: 6680916730816870145 time 0.189408
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:29] [V] [TRT] Tactic: 7158029511300006471 time 0.181784
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:29] [V] [TRT] Tactic: 7859952145590271433 time 0.191296
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:29] [V] [TRT] Tactic: 8283847742354150423 time 0.179996
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:29] [V] [TRT] Tactic: -4534876761957424274 time 0.165716
[08/16/2021-04:54:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:29] [V] [TRT] Tactic: -3237051169894153788 time 0.17982
[08/16/2021-04:54:29] [V] [TRT] Fastest Tactic: -4534876761957424274 Time: 0.165716
[08/16/2021-04:54:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (CudaConvolution)
[08/16/2021-04:54:30] [V] [TRT] Tactic: 0 time 45.6032
[08/16/2021-04:54:30] [V] [TRT] Tactic: 1 time 1.44318
[08/16/2021-04:54:30] [V] [TRT] Tactic: 2 time 1.2894
[08/16/2021-04:54:30] [V] [TRT] Tactic: 6 skipped. Scratch requested: 18614784, available: 16777216
[08/16/2021-04:54:30] [V] [TRT] Fastest Tactic: 2 Time: 1.2894
[08/16/2021-04:54:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4534876761957424274
[08/16/2021-04:54:30] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:30] [V] [TRT] 
[08/16/2021-04:54:30] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:30] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:30] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:30] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:30] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:30] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:30] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:30] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:30] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:30] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:30] [V] [TRT] Tactic: 1002 time 0.034752
[08/16/2021-04:54:30] [V] [TRT] Tactic: 0 time 0.036944
[08/16/2021-04:54:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.034752
[08/16/2021-04:54:30] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:30] [V] [TRT] Tactic: 1002 time 0.059092
[08/16/2021-04:54:30] [V] [TRT] Tactic: 0 time 0.022916
[08/16/2021-04:54:30] [V] [TRT] Fastest Tactic: 0 Time: 0.022916
[08/16/2021-04:54:30] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:30] [V] [TRT] Tactic: 1002 time 0.043908
[08/16/2021-04:54:30] [V] [TRT] Tactic: 0 time 0.022964
[08/16/2021-04:54:30] [V] [TRT] Fastest Tactic: 0 Time: 0.022964
[08/16/2021-04:54:30] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:30] [V] [TRT] Tactic: 1002 time 0.037912
[08/16/2021-04:54:30] [V] [TRT] Tactic: 0 time 0.032272
[08/16/2021-04:54:30] [V] [TRT] Fastest Tactic: 0 Time: 0.032272
[08/16/2021-04:54:30] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:30] [V] [TRT] Tactic: 1002 time 0.057196
[08/16/2021-04:54:30] [V] [TRT] Tactic: 0 time 0.01812
[08/16/2021-04:54:30] [V] [TRT] Fastest Tactic: 0 Time: 0.01812
[08/16/2021-04:54:30] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:30] [V] [TRT] Tactic: 1002 time 0.04138
[08/16/2021-04:54:30] [V] [TRT] Tactic: 0 time 0.0178
[08/16/2021-04:54:30] [V] [TRT] Fastest Tactic: 0 Time: 0.0178
[08/16/2021-04:54:30] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:30] [V] [TRT] Tactic: 1002 time 0.069312
[08/16/2021-04:54:30] [V] [TRT] Tactic: 0 time 0.024828
[08/16/2021-04:54:30] [V] [TRT] Fastest Tactic: 0 Time: 0.024828
[08/16/2021-04:54:30] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:30] [V] [TRT] Tactic: 1002 time 0.067584
[08/16/2021-04:54:30] [V] [TRT] Tactic: 0 time 0.017228
[08/16/2021-04:54:30] [V] [TRT] Fastest Tactic: 0 Time: 0.017228
[08/16/2021-04:54:30] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:30] [V] [TRT] Tactic: 1002 time 0.041772
[08/16/2021-04:54:30] [V] [TRT] Tactic: 0 time 0.016584
[08/16/2021-04:54:30] [V] [TRT] Fastest Tactic: 0 Time: 0.016584
[08/16/2021-04:54:30] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:30] [V] [TRT] Tactic: 1002 time 0.04328
[08/16/2021-04:54:30] [V] [TRT] Tactic: 0 time 0.022068
[08/16/2021-04:54:30] [V] [TRT] Fastest Tactic: 0 Time: 0.022068
[08/16/2021-04:54:30] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:30] [V] [TRT] Tactic: 1002 time 0.041352
[08/16/2021-04:54:30] [V] [TRT] Tactic: 0 time 0.014208
[08/16/2021-04:54:30] [V] [TRT] Fastest Tactic: 0 Time: 0.014208
[08/16/2021-04:54:30] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:30] [V] [TRT] Tactic: 1002 time 0.062908
[08/16/2021-04:54:30] [V] [TRT] Tactic: 0 time 0.015024
[08/16/2021-04:54:30] [V] [TRT] Fastest Tactic: 0 Time: 0.015024
[08/16/2021-04:54:30] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:54:30] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:54:30] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:54:30] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:54:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6 (CaskConvolution)
[08/16/2021-04:54:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6 (CudaConvolution)
[08/16/2021-04:54:30] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:30] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:54:30] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:30] [V] [TRT] Tactic: 1002 time 0.30078
[08/16/2021-04:54:30] [V] [TRT] Tactic: 0 time 0.795204
[08/16/2021-04:54:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.30078
[08/16/2021-04:54:30] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:30] [V] [TRT] Tactic: 1002 time 0.225044
[08/16/2021-04:54:30] [V] [TRT] Tactic: 0 time 0.222132
[08/16/2021-04:54:30] [V] [TRT] Fastest Tactic: 0 Time: 0.222132
[08/16/2021-04:54:30] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.388468
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.140184
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.140184
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.29698
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.141524
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.141524
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.257704
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.2137
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.2137
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.306284
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.758544
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.306284
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.393512
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.114808
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.114808
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.29842
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.106628
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.106628
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.492396
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.156444
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.156444
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.299
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.735868
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.299
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.48696
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.112148
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.112148
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.298988
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.106424
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.106424
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.303144
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.139032
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.139032
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.299972
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 1.62482
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.299972
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.299972
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.093432
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.093432
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.419024
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.094232
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.094232
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.300848
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.816356
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.300848
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.306576
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.762692
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.306576
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.29912
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.71788
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.29912
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.300756
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 1.63874
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.300756
[08/16/2021-04:54:31] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1048576,1048576) ***************
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577 (Shuffle)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.185428
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1 time 0.50634
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.185428
[08/16/2021-04:54:31] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,32768) -> Float(1,64,4096:32,32768,32768) ***************
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577 (Shuffle)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 1.3154
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1 time 0.81424
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 1 Time: 0.81424
[08/16/2021-04:54:31] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576) -> Half(1,64,4096,1048576,1048576) ***************
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577 (Shuffle)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.101336
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1 time 0.436808
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.101336
[08/16/2021-04:54:31] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288) -> Half(1,64,4096:2,524288,524288) ***************
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577 (Shuffle)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.099216
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1 time 0.87904
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.099216
[08/16/2021-04:54:31] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Half(32,2048,1:8,131072,131072) ***************
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577 (Shuffle)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.658972
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1 time 0.594224
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 1 Time: 0.594224
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.2988
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.813136
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.2988
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.225016
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.221764
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.221764
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.392232
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.140968
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.140968
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.298916
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.142552
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.142552
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.517528
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.339156
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.339156
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.502752
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.302324
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.302324
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.413604
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.335652
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.335652
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.302784
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.220044
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.220044
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.259712
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.214312
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.214312
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.30428
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.758608
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.30428
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.393988
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.114028
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.114028
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.298404
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.107244
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.107244
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.488956
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.156808
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.156808
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.297776
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.741068
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.297776
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.486856
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.11306
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.11306
[08/16/2021-04:54:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:31] [V] [TRT] Tactic: 1002 time 0.296616
[08/16/2021-04:54:31] [V] [TRT] Tactic: 0 time 0.106688
[08/16/2021-04:54:31] [V] [TRT] Fastest Tactic: 0 Time: 0.106688
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.302712
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.1406
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.1406
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.300392
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 1.7293
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.300392
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.298708
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.094012
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.094012
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.423152
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.093952
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.093952
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.275308
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.185568
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.185568
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.345964
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.81132
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.345964
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.253084
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.150248
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.150248
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.414432
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.208156
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.208156
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.348496
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 1.06226
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.348496
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.551668
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.339536
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.339536
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.350224
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.182996
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.182996
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.546564
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.302956
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.302956
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.433776
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.337636
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.337636
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.35012
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.99546
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.35012
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.2732
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.157156
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.157156
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.352468
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.766856
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.352468
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.250988
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.094924
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.094924
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.415964
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.195272
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.195272
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.35172
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.952156
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.35172
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.532604
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.20894
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.20894
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.347316
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.736968
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.347316
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.53546
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.1957
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.1957
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.407484
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.094776
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.094776
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.346556
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.495092
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.346556
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.349452
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.318596
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.318596
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.34572
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 1.64828
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.34572
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.350012
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.281876
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.281876
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.438844
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.196044
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.196044
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.554136
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.671404
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.554136
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.278068
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.183392
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.183392
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.34792
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.836256
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.34792
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.25462
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.151484
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.151484
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.40896
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.208388
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.208388
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.348504
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.957496
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.348504
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.551352
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.340464
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.340464
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.348564
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.183076
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.183076
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.542988
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.301072
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.301072
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:32] [V] [TRT] Tactic: 1002 time 0.432332
[08/16/2021-04:54:32] [V] [TRT] Tactic: 0 time 0.339128
[08/16/2021-04:54:32] [V] [TRT] Fastest Tactic: 0 Time: 0.339128
[08/16/2021-04:54:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.348396
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.996268
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.348396
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.274044
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.159136
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.159136
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.352928
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.75858
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.352928
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.247844
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.095616
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.095616
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.413652
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.1952
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.1952
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.349556
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.977464
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.349556
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.53362
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.209008
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.209008
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.347204
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.729608
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.347204
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.534576
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.195676
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.195676
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.408772
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.09456
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.09456
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.34542
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.49064
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.34542
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.350448
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.329368
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.329368
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.344184
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 1.6522
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.344184
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.350868
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.281032
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.281032
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.437308
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.187588
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.187588
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0 copy (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.555328
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.670092
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.555328
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.566152
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 1.62216
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.566152
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.443424
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.433468
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.433468
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.751352
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.275144
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.275144
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.553776
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.280036
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.280036
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 1.14576
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.677744
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.677744
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.998376
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.594456
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.594456
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.805644
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.662024
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.662024
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.570532
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.432876
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.432876
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.520052
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.422016
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.422016
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.570332
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 1.49806
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.570332
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.749736
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.221604
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.221604
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.559232
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.204004
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.204004
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.983836
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.306624
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.306624
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.561468
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 1.44484
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.561468
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.976248
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.217472
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.217472
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.552784
[08/16/2021-04:54:33] [V] [TRT] Tactic: 0 time 0.206728
[08/16/2021-04:54:33] [V] [TRT] Fastest Tactic: 0 Time: 0.206728
[08/16/2021-04:54:33] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:33] [V] [TRT] Tactic: 1002 time 0.572376
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 0.273452
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 0 Time: 0.273452
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1002 time 0.566984
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 3.37667
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.566984
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1002 time 0.558908
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 0.182088
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 0 Time: 0.182088
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1002 time 0.823936
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 0.182932
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 0 Time: 0.182932
[08/16/2021-04:54:34] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576,2097152) -> Float(1,64,64,4096,1048576,2097152) ***************
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581 (Shuffle)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 0.361748
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1 time 1.0455
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 0 Time: 0.361748
[08/16/2021-04:54:34] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,32768,65536) -> Float(1,64,64:32,128,32768,65536) ***************
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581 (Shuffle)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 1.6742
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1 time 1.6567
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 1 Time: 1.6567
[08/16/2021-04:54:34] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576,2097152) -> Half(1,64,64,4096,1048576,2097152) ***************
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581 (Shuffle)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 0.189828
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1 time 0.918548
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 0 Time: 0.189828
[08/16/2021-04:54:34] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288,1048576) -> Half(1,64,64:2,2048,524288,1048576) ***************
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581 (Shuffle)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 0.564876
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1 time 1.75185
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 0 Time: 0.564876
[08/16/2021-04:54:34] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072,262144) -> Half(8,512,1:8,512,131072,262144) ***************
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581 (Shuffle)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 1.45468
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1 time 1.30017
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 1 Time: 1.30017
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1002 time 0.648508
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 1.30138
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.648508
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1002 time 0.500316
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 0.433724
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 0 Time: 0.433724
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1002 time 0.785816
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 0.279208
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 0 Time: 0.279208
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1002 time 0.646184
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 0.265544
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 0 Time: 0.265544
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1002 time 2.71874
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 0.423716
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 0 Time: 0.423716
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1002 time 2.7095
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 0.376172
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 0 Time: 0.376172
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1002 time 0.83298
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 0.433892
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 0 Time: 0.433892
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1002 time 0.656236
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 0.432056
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 0 Time: 0.432056
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1002 time 0.546928
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 0.421828
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 0 Time: 0.421828
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1002 time 0.652264
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 1.29681
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.652264
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1002 time 0.793696
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 0.218288
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 0 Time: 0.218288
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1002 time 0.650436
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 0.189856
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 0 Time: 0.189856
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1002 time 2.72793
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 0.303872
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 0 Time: 0.303872
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:34] [V] [TRT] Tactic: 1002 time 0.6462
[08/16/2021-04:54:34] [V] [TRT] Tactic: 0 time 1.29522
[08/16/2021-04:54:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.6462
[08/16/2021-04:54:34] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 2.7297
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 0.214104
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 0 Time: 0.214104
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 0.646392
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 0.201116
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 0 Time: 0.201116
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 0.655136
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 0.26876
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 0 Time: 0.26876
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 0.649548
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 1.42439
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.649548
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 0.65052
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 0.180464
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 0 Time: 0.180464
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 0.84248
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 0.182608
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 0 Time: 0.182608
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 1.20873
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 0.361832
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 0 Time: 0.361832
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 0.648736
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 1.29741
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.648736
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 1.22813
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 0.293368
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 0 Time: 0.293368
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 0.831548
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 0.343536
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 0 Time: 0.343536
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 0.647668
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 0.375124
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 0 Time: 0.375124
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 2.71218
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 0.422536
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 0 Time: 0.422536
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 0.659464
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 1.47541
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.659464
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 2.71116
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 0.372676
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 0 Time: 0.372676
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 0.87718
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 0.434412
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 0 Time: 0.434412
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 0.656088
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 0.432144
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 0 Time: 0.432144
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 1.22765
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 0.306716
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 0 Time: 0.306716
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 0.652152
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 1.29425
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.652152
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 1.24453
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 0.269468
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 0 Time: 0.269468
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 0.8367
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 0.31688
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 0 Time: 0.31688
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 0.6515
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 0.366
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 0 Time: 0.366
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 2.7301
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 0.350816
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 0 Time: 0.350816
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 0.644936
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 1.29333
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.644936
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 2.7407
[08/16/2021-04:54:35] [V] [TRT] Tactic: 0 time 0.31974
[08/16/2021-04:54:35] [V] [TRT] Fastest Tactic: 0 Time: 0.31974
[08/16/2021-04:54:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:35] [V] [TRT] Tactic: 1002 time 0.823968
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 0.186324
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 0 Time: 0.186324
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 0.64554
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 0.3989
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 0 Time: 0.3989
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 0.654016
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 0.382344
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 0 Time: 0.382344
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 0.650868
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 1.42447
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.650868
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 0.65056
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 0.365852
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 0 Time: 0.365852
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 0.869904
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 0.399964
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 0 Time: 0.399964
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 2.74536
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 0.181596
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 0 Time: 0.181596
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 1.20808
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 0.367932
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 0 Time: 0.367932
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 0.647676
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 1.29718
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.647676
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 1.135
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 0.29362
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 0 Time: 0.29362
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 0.832992
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 0.344328
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 0 Time: 0.344328
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 0.647104
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 0.37408
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 0 Time: 0.37408
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 2.72406
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 0.423768
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 0 Time: 0.423768
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 0.661588
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 1.47536
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.661588
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 2.3695
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 0.372912
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 0 Time: 0.372912
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 0.872176
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 0.434288
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 0 Time: 0.434288
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 0.65768
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 0.43214
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 0 Time: 0.43214
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 1.22778
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 0.3077
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 0 Time: 0.3077
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 0.652468
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 1.29451
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.652468
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 1.24692
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 0.268976
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 0 Time: 0.268976
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 0.834728
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 0.317056
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 0 Time: 0.317056
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 0.651036
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 0.365696
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 0 Time: 0.365696
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 2.7342
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 0.350916
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 0 Time: 0.350916
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:36] [V] [TRT] Tactic: 1002 time 0.645636
[08/16/2021-04:54:36] [V] [TRT] Tactic: 0 time 1.29328
[08/16/2021-04:54:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.645636
[08/16/2021-04:54:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:37] [V] [TRT] Tactic: 1002 time 2.74101
[08/16/2021-04:54:37] [V] [TRT] Tactic: 0 time 0.319444
[08/16/2021-04:54:37] [V] [TRT] Fastest Tactic: 0 Time: 0.319444
[08/16/2021-04:54:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:37] [V] [TRT] Tactic: 1002 time 0.829984
[08/16/2021-04:54:37] [V] [TRT] Tactic: 0 time 0.18412
[08/16/2021-04:54:37] [V] [TRT] Fastest Tactic: 0 Time: 0.18412
[08/16/2021-04:54:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:37] [V] [TRT] Tactic: 1002 time 0.64624
[08/16/2021-04:54:37] [V] [TRT] Tactic: 0 time 0.399448
[08/16/2021-04:54:37] [V] [TRT] Fastest Tactic: 0 Time: 0.399448
[08/16/2021-04:54:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:37] [V] [TRT] Tactic: 1002 time 0.650832
[08/16/2021-04:54:37] [V] [TRT] Tactic: 0 time 0.381752
[08/16/2021-04:54:37] [V] [TRT] Fastest Tactic: 0 Time: 0.381752
[08/16/2021-04:54:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:37] [V] [TRT] Tactic: 1002 time 0.650356
[08/16/2021-04:54:37] [V] [TRT] Tactic: 0 time 1.42492
[08/16/2021-04:54:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.650356
[08/16/2021-04:54:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:37] [V] [TRT] Tactic: 1002 time 0.650988
[08/16/2021-04:54:37] [V] [TRT] Tactic: 0 time 0.365612
[08/16/2021-04:54:37] [V] [TRT] Fastest Tactic: 0 Time: 0.365612
[08/16/2021-04:54:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:37] [V] [TRT] Tactic: 1002 time 0.869964
[08/16/2021-04:54:37] [V] [TRT] Tactic: 0 time 0.39942
[08/16/2021-04:54:37] [V] [TRT] Fastest Tactic: 0 Time: 0.39942
[08/16/2021-04:54:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_1_Unsqueeze__581:0 copy (Reformat)
[08/16/2021-04:54:37] [V] [TRT] Tactic: 1002 time 2.74787
[08/16/2021-04:54:37] [V] [TRT] Tactic: 0 time 0.1815
[08/16/2021-04:54:37] [V] [TRT] Fastest Tactic: 0 Time: 0.1815
[08/16/2021-04:54:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:37] [V] [TRT] Tactic: 1002 time 1.11057
[08/16/2021-04:54:37] [V] [TRT] Tactic: 0 time 2.59815
[08/16/2021-04:54:37] [V] [TRT] Fastest Tactic: 1002 Time: 1.11057
[08/16/2021-04:54:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:37] [V] [TRT] Tactic: 1002 time 0.875864
[08/16/2021-04:54:37] [V] [TRT] Tactic: 0 time 0.856696
[08/16/2021-04:54:37] [V] [TRT] Fastest Tactic: 0 Time: 0.856696
[08/16/2021-04:54:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:37] [V] [TRT] Tactic: 1002 time 1.5912
[08/16/2021-04:54:37] [V] [TRT] Tactic: 0 time 0.543408
[08/16/2021-04:54:37] [V] [TRT] Fastest Tactic: 0 Time: 0.543408
[08/16/2021-04:54:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:37] [V] [TRT] Tactic: 1002 time 1.10057
[08/16/2021-04:54:37] [V] [TRT] Tactic: 0 time 0.531736
[08/16/2021-04:54:37] [V] [TRT] Fastest Tactic: 0 Time: 0.531736
[08/16/2021-04:54:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:37] [V] [TRT] Tactic: 1002 time 2.81452
[08/16/2021-04:54:37] [V] [TRT] Tactic: 0 time 0.951416
[08/16/2021-04:54:37] [V] [TRT] Fastest Tactic: 0 Time: 0.951416
[08/16/2021-04:54:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:37] [V] [TRT] Tactic: 1002 time 2.82356
[08/16/2021-04:54:37] [V] [TRT] Tactic: 0 time 0.873216
[08/16/2021-04:54:37] [V] [TRT] Fastest Tactic: 0 Time: 0.873216
[08/16/2021-04:54:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:37] [V] [TRT] Tactic: 1002 time 1.67157
[08/16/2021-04:54:37] [V] [TRT] Tactic: 0 time 0.908004
[08/16/2021-04:54:37] [V] [TRT] Fastest Tactic: 0 Time: 0.908004
[08/16/2021-04:54:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:37] [V] [TRT] Tactic: 1002 time 1.13776
[08/16/2021-04:54:37] [V] [TRT] Tactic: 0 time 0.856596
[08/16/2021-04:54:37] [V] [TRT] Fastest Tactic: 0 Time: 0.856596
[08/16/2021-04:54:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:37] [V] [TRT] Tactic: 1002 time 1.02817
[08/16/2021-04:54:37] [V] [TRT] Tactic: 0 time 0.836704
[08/16/2021-04:54:37] [V] [TRT] Fastest Tactic: 0 Time: 0.836704
[08/16/2021-04:54:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:37] [V] [TRT] Tactic: 1002 time 1.12016
[08/16/2021-04:54:37] [V] [TRT] Tactic: 0 time 2.58844
[08/16/2021-04:54:37] [V] [TRT] Fastest Tactic: 1002 Time: 1.12016
[08/16/2021-04:54:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:37] [V] [TRT] Tactic: 1002 time 1.5871
[08/16/2021-04:54:37] [V] [TRT] Tactic: 0 time 0.428164
[08/16/2021-04:54:37] [V] [TRT] Fastest Tactic: 0 Time: 0.428164
[08/16/2021-04:54:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:37] [V] [TRT] Tactic: 1002 time 1.1003
[08/16/2021-04:54:37] [V] [TRT] Tactic: 0 time 0.383744
[08/16/2021-04:54:37] [V] [TRT] Fastest Tactic: 0 Time: 0.383744
[08/16/2021-04:54:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:38] [V] [TRT] Tactic: 1002 time 2.84724
[08/16/2021-04:54:38] [V] [TRT] Tactic: 0 time 0.618664
[08/16/2021-04:54:38] [V] [TRT] Fastest Tactic: 0 Time: 0.618664
[08/16/2021-04:54:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:38] [V] [TRT] Tactic: 1002 time 1.1094
[08/16/2021-04:54:38] [V] [TRT] Tactic: 0 time 2.60345
[08/16/2021-04:54:38] [V] [TRT] Fastest Tactic: 1002 Time: 1.1094
[08/16/2021-04:54:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:38] [V] [TRT] Tactic: 1002 time 2.82456
[08/16/2021-04:54:38] [V] [TRT] Tactic: 0 time 0.424548
[08/16/2021-04:54:38] [V] [TRT] Fastest Tactic: 0 Time: 0.424548
[08/16/2021-04:54:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:38] [V] [TRT] Tactic: 1002 time 1.10013
[08/16/2021-04:54:38] [V] [TRT] Tactic: 0 time 0.394372
[08/16/2021-04:54:38] [V] [TRT] Fastest Tactic: 0 Time: 0.394372
[08/16/2021-04:54:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:38] [V] [TRT] Tactic: 1002 time 1.11304
[08/16/2021-04:54:38] [V] [TRT] Tactic: 0 time 0.534148
[08/16/2021-04:54:38] [V] [TRT] Fastest Tactic: 0 Time: 0.534148
[08/16/2021-04:54:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:38] [V] [TRT] Tactic: 1002 time 1.12482
[08/16/2021-04:54:38] [V] [TRT] Tactic: 0 time 2.86049
[08/16/2021-04:54:38] [V] [TRT] Fastest Tactic: 1002 Time: 1.12482
[08/16/2021-04:54:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:38] [V] [TRT] Tactic: 1002 time 1.10429
[08/16/2021-04:54:38] [V] [TRT] Tactic: 0 time 0.355908
[08/16/2021-04:54:38] [V] [TRT] Fastest Tactic: 0 Time: 0.355908
[08/16/2021-04:54:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:38] [V] [TRT] Tactic: 1002 time 1.68015
[08/16/2021-04:54:38] [V] [TRT] Tactic: 0 time 0.355084
[08/16/2021-04:54:38] [V] [TRT] Fastest Tactic: 0 Time: 0.355084
[08/16/2021-04:54:38] [V] [TRT] *************** Autotuning format combination: Float(1,64,128,8192,2097152,4194304) -> Float(1,128,16384,4194304) ***************
[08/16/2021-04:54:38] [V] [TRT] --------------- Timing Runner: Transpose__788 + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape + Transpose__738 (Shuffle)
[08/16/2021-04:54:38] [V] [TRT] Tactic: 0 time 0.834192
[08/16/2021-04:54:38] [V] [TRT] Tactic: 1 time 1.52638
[08/16/2021-04:54:38] [V] [TRT] Fastest Tactic: 0 Time: 0.834192
[08/16/2021-04:54:38] [V] [TRT] *************** Autotuning format combination: Float(1,64,128:32,256,65536,131072) -> Float(1,128,16384:32,131072) ***************
[08/16/2021-04:54:38] [V] [TRT] --------------- Timing Runner: Transpose__788 + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape + Transpose__738 (Shuffle)
[08/16/2021-04:54:38] [V] [TRT] Tactic: 0 time 4.16637
[08/16/2021-04:54:38] [V] [TRT] Tactic: 1 time 2.48208
[08/16/2021-04:54:38] [V] [TRT] Fastest Tactic: 1 Time: 2.48208
[08/16/2021-04:54:38] [V] [TRT] *************** Autotuning format combination: Half(1,64,128,8192,2097152,4194304) -> Half(1,128,16384,4194304) ***************
[08/16/2021-04:54:38] [V] [TRT] --------------- Timing Runner: Transpose__788 + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape + Transpose__738 (Shuffle)
[08/16/2021-04:54:38] [V] [TRT] Tactic: 0 time 0.819312
[08/16/2021-04:54:38] [V] [TRT] Tactic: 1 time 1.22286
[08/16/2021-04:54:38] [V] [TRT] Fastest Tactic: 0 Time: 0.819312
[08/16/2021-04:54:38] [V] [TRT] *************** Autotuning format combination: Half(1,64,128:2,4096,1048576,2097152) -> Half(1,128,16384:2,2097152) ***************
[08/16/2021-04:54:38] [V] [TRT] --------------- Timing Runner: Transpose__788 + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape + Transpose__738 (Shuffle)
[08/16/2021-04:54:38] [V] [TRT] Tactic: 0 time 1.1312
[08/16/2021-04:54:38] [V] [TRT] Tactic: 1 time 3.67071
[08/16/2021-04:54:38] [V] [TRT] Fastest Tactic: 0 Time: 1.1312
[08/16/2021-04:54:38] [V] [TRT] *************** Autotuning format combination: Half(8,512,1:8,1024,262144,524288) -> Half(32,4096,1:8,524288) ***************
[08/16/2021-04:54:38] [V] [TRT] --------------- Timing Runner: Transpose__788 + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape + Transpose__738 (Shuffle)
[08/16/2021-04:54:38] [V] [TRT] Tactic: 0 time 3.62474
[08/16/2021-04:54:38] [V] [TRT] Tactic: 1 time 3.07895
[08/16/2021-04:54:38] [V] [TRT] Fastest Tactic: 1 Time: 3.07895
[08/16/2021-04:54:38] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:38] [V] [TRT] Tactic: 1002 time 0.939684
[08/16/2021-04:54:38] [V] [TRT] Tactic: 0 time 0.857204
[08/16/2021-04:54:38] [V] [TRT] Fastest Tactic: 0 Time: 0.857204
[08/16/2021-04:54:39] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:39] [V] [TRT] Tactic: 1002 time 1.81141
[08/16/2021-04:54:39] [V] [TRT] Tactic: 0 time 0.556204
[08/16/2021-04:54:39] [V] [TRT] Fastest Tactic: 0 Time: 0.556204
[08/16/2021-04:54:39] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:39] [V] [TRT] Tactic: 1002 time 1.10612
[08/16/2021-04:54:39] [V] [TRT] Tactic: 0 time 0.547668
[08/16/2021-04:54:39] [V] [TRT] Fastest Tactic: 0 Time: 0.547668
[08/16/2021-04:54:39] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:39] [V] [TRT] Tactic: 1002 time 2.72742
[08/16/2021-04:54:39] [V] [TRT] Tactic: 0 time 3.17875
[08/16/2021-04:54:39] [V] [TRT] Fastest Tactic: 1002 Time: 2.72742
[08/16/2021-04:54:39] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:39] [V] [TRT] Tactic: 1002 time 2.59448
[08/16/2021-04:54:39] [V] [TRT] Tactic: 0 time 2.98599
[08/16/2021-04:54:39] [V] [TRT] Fastest Tactic: 1002 Time: 2.59448
[08/16/2021-04:54:39] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:39] [V] [TRT] Tactic: 1002 time 1.7699
[08/16/2021-04:54:39] [V] [TRT] Tactic: 0 time 3.5601
[08/16/2021-04:54:39] [V] [TRT] Fastest Tactic: 1002 Time: 1.7699
[08/16/2021-04:54:39] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:39] [V] [TRT] Tactic: 1002 time 1.13524
[08/16/2021-04:54:39] [V] [TRT] Tactic: 0 time 0.8581
[08/16/2021-04:54:39] [V] [TRT] Fastest Tactic: 0 Time: 0.8581
[08/16/2021-04:54:39] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:39] [V] [TRT] Tactic: 1002 time 1.0364
[08/16/2021-04:54:39] [V] [TRT] Tactic: 0 time 0.836416
[08/16/2021-04:54:39] [V] [TRT] Fastest Tactic: 0 Time: 0.836416
[08/16/2021-04:54:39] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:39] [V] [TRT] Tactic: 1002 time 1.80519
[08/16/2021-04:54:39] [V] [TRT] Tactic: 0 time 0.439532
[08/16/2021-04:54:39] [V] [TRT] Fastest Tactic: 0 Time: 0.439532
[08/16/2021-04:54:39] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:39] [V] [TRT] Tactic: 1002 time 1.11161
[08/16/2021-04:54:39] [V] [TRT] Tactic: 0 time 0.403032
[08/16/2021-04:54:39] [V] [TRT] Fastest Tactic: 0 Time: 0.403032
[08/16/2021-04:54:39] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:39] [V] [TRT] Tactic: 1002 time 1.98881
[08/16/2021-04:54:39] [V] [TRT] Tactic: 0 time 0.551388
[08/16/2021-04:54:39] [V] [TRT] Fastest Tactic: 0 Time: 0.551388
[08/16/2021-04:54:39] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:39] [V] [TRT] Tactic: 1002 time 1.9562
[08/16/2021-04:54:39] [V] [TRT] Tactic: 0 time 0.42204
[08/16/2021-04:54:39] [V] [TRT] Fastest Tactic: 0 Time: 0.42204
[08/16/2021-04:54:39] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:39] [V] [TRT] Tactic: 1002 time 1.09706
[08/16/2021-04:54:39] [V] [TRT] Tactic: 0 time 0.415636
[08/16/2021-04:54:39] [V] [TRT] Fastest Tactic: 0 Time: 0.415636
[08/16/2021-04:54:39] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:39] [V] [TRT] Tactic: 1002 time 1.14063
[08/16/2021-04:54:39] [V] [TRT] Tactic: 0 time 0.555996
[08/16/2021-04:54:39] [V] [TRT] Fastest Tactic: 0 Time: 0.555996
[08/16/2021-04:54:39] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:39] [V] [TRT] Tactic: 1002 time 1.1125
[08/16/2021-04:54:39] [V] [TRT] Tactic: 0 time 0.367328
[08/16/2021-04:54:39] [V] [TRT] Fastest Tactic: 0 Time: 0.367328
[08/16/2021-04:54:39] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:39] [V] [TRT] Tactic: 1002 time 1.74702
[08/16/2021-04:54:39] [V] [TRT] Tactic: 0 time 0.358772
[08/16/2021-04:54:39] [V] [TRT] Fastest Tactic: 0 Time: 0.358772
[08/16/2021-04:54:39] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,8388608), Float(1,128,16384,4194304) -> Float(1,128,16384,4194304) ***************
[08/16/2021-04:54:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:54:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:54:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:54:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:54:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:54:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:54:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:54:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:54:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (CaskConvolution)
[08/16/2021-04:54:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:54:39] [V] [TRT] Tactic: 1754569683116234317 time 5.74463
[08/16/2021-04:54:39] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:54:40] [V] [TRT] Tactic: 1825138533642645384 time 5.72749
[08/16/2021-04:54:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:54:40] [V] [TRT] Tactic: 2733356012094739613 time 6.80425
[08/16/2021-04:54:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:54:40] [V] [TRT] Tactic: 3915320020053085238 time 5.71308
[08/16/2021-04:54:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:40] [V] [TRT] Tactic: 6808617066150061604 time 5.69142
[08/16/2021-04:54:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:54:40] [V] [TRT] Tactic: 9091006216302412844 time 5.50652
[08/16/2021-04:54:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:54:40] [V] [TRT] Tactic: -8060443123034038864 time 5.79042
[08/16/2021-04:54:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:54:40] [V] [TRT] Tactic: -4420849921117327522 time 7.82518
[08/16/2021-04:54:40] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:54:40] [V] [TRT] Tactic: -3946921629105938337 time 8.07462
[08/16/2021-04:54:40] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 5.50652
[08/16/2021-04:54:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (CudaConvolution)
[08/16/2021-04:54:41] [V] [TRT] Tactic: 0 time 10.4594
[08/16/2021-04:54:41] [V] [TRT] Tactic: 2 skipped. Scratch requested: 33554432, available: 16777216
[08/16/2021-04:54:41] [V] [TRT] Tactic: 5 skipped. Scratch requested: 44564480, available: 16777216
[08/16/2021-04:54:41] [V] [TRT] Tactic: 57 time 7.9246
[08/16/2021-04:54:41] [V] [TRT] Fastest Tactic: 57 Time: 7.9246
[08/16/2021-04:54:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:54:41] [V] [TRT] 
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[08/16/2021-04:54:41] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,8388608), Half(1,128,16384,4194304) -> Half(1,128,16384,4194304) ***************
[08/16/2021-04:54:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (CaskConvolution)
[08/16/2021-04:54:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (CudaConvolution)
[08/16/2021-04:54:41] [V] [TRT] Tactic: 0 time 8.49844
[08/16/2021-04:54:41] [V] [TRT] Tactic: 1 time 7.0616
[08/16/2021-04:54:41] [V] [TRT] Tactic: 2 time 8.18095
[08/16/2021-04:54:41] [V] [TRT] Tactic: 4 skipped. Scratch requested: 17516986368, available: 16777216
[08/16/2021-04:54:41] [V] [TRT] Tactic: 5 skipped. Scratch requested: 44564480, available: 16777216
[08/16/2021-04:54:41] [V] [TRT] Fastest Tactic: 1 Time: 7.0616
[08/16/2021-04:54:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:54:41] [V] [TRT] 
[08/16/2021-04:54:41] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,4194304), Half(1,128,16384:2,2097152) -> Half(1,128,16384:2,2097152) ***************
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (CaskConvolution)
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:41] [V] [TRT] Tactic: 2418518597804310654 time 2.83484
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:41] [V] [TRT] Tactic: 8292881859266835088 time 3.57115
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:41] [V] [TRT] Tactic: 8401509141903434922 time 3.18543
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:41] [V] [TRT] Tactic: -8654297089785671176 time 3.0376
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:54:41] [V] [TRT] Tactic: -7140760933967189247 time 2.78566
[08/16/2021-04:54:41] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:54:42] [V] [TRT] Tactic: -4097850214384059472 time 3.28521
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:42] [V] [TRT] Tactic: -3689982367035295496 time 3.04145
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:54:42] [V] [TRT] Tactic: -2534402059426524406 time 2.92313
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:42] [V] [TRT] Tactic: -2027588946874785071 time 3.48247
[08/16/2021-04:54:42] [V] [TRT] Fastest Tactic: -7140760933967189247 Time: 2.78566
[08/16/2021-04:54:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (CudaConvolution)
[08/16/2021-04:54:42] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7140760933967189247
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:54:42] [V] [TRT] 
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1
[08/16/2021-04:54:42] [V] [TRT] *************** Autotuning format combination: Half(64,8192,1:8,1048576), Float(1,128,16384,4194304) -> Float(1,128,16384,4194304) ***************
[08/16/2021-04:54:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (CaskConvolution)
[08/16/2021-04:54:42] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (CudaConvolution)
[08/16/2021-04:54:42] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:42] [V] [TRT] *************** Autotuning format combination: Half(64,8192,1:8,1048576), Half(32,4096,1:8,524288) -> Half(32,4096,1:8,524288) ***************
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (CaskConvolution)
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] Tactic: 2105695814191699972 time 1.30229
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] Tactic: 3754069740140581927 time 1.17974
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] Tactic: 5666160310350604399 time 1.1747
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] Tactic: 5925270497649423688 time 1.16408
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] Tactic: 6680916730816870145 time 1.50392
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] Tactic: 7158029511300006471 time 1.28661
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] Tactic: 7859952145590271433 time 1.49498
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] Tactic: 8283847742354150423 time 1.17112
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] Tactic: -8391760416076885205 time 1.18388
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] Tactic: -4534876761957424274 time 1.18716
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] Tactic: -3237051169894153788 time 1.31161
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] Tactic: -2422160065350346448 time 1.47579
[08/16/2021-04:54:42] [V] [TRT] Fastest Tactic: 5925270497649423688 Time: 1.16408
[08/16/2021-04:54:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (CudaConvolution)
[08/16/2021-04:54:42] [V] [TRT] Tactic: 0 time 9.09042
[08/16/2021-04:54:42] [V] [TRT] Tactic: 1 time 10.3396
[08/16/2021-04:54:42] [V] [TRT] Tactic: 2 skipped. Scratch requested: 25166336, available: 16777216
[08/16/2021-04:54:42] [V] [TRT] Fastest Tactic: 0 Time: 9.09042
[08/16/2021-04:54:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5925270497649423688
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] 
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:42] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,4194304) -> Float(1,128,16384,4194304) ***************
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:54:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:42] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (CaskConvolution)
[08/16/2021-04:54:42] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:54:43] [V] [TRT] Tactic: 1825138533642645384 time 23.5338
[08/16/2021-04:54:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:54:43] [V] [TRT] Tactic: 2842488832350522458 time 23.6099
[08/16/2021-04:54:43] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:54:44] [V] [TRT] Tactic: 3915320020053085238 time 23.5266
[08/16/2021-04:54:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:54:44] [V] [TRT] Tactic: 6448355332020552203 time 23.8151
[08/16/2021-04:54:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:44] [V] [TRT] Tactic: 6808617066150061604 time 23.846
[08/16/2021-04:54:44] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:54:45] [V] [TRT] Tactic: -8060443123034038864 time 24.0994
[08/16/2021-04:54:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:54:45] [V] [TRT] Tactic: -4420849921117327522 time 25.7706
[08/16/2021-04:54:45] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:54:46] [V] [TRT] Tactic: -3946921629105938337 time 25.5781
[08/16/2021-04:54:46] [V] [TRT] Fastest Tactic: 3915320020053085238 Time: 23.5266
[08/16/2021-04:54:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (CudaConvolution)
[08/16/2021-04:54:46] [V] [TRT] Tactic: 0 time 30.8321
[08/16/2021-04:54:46] [V] [TRT] Tactic: 2 skipped. Scratch requested: 150994944, available: 16777216
[08/16/2021-04:54:46] [V] [TRT] Tactic: 5 skipped. Scratch requested: 289669120, available: 16777216
[08/16/2021-04:54:46] [V] [TRT] Tactic: 6 time 16.4196
[08/16/2021-04:54:46] [V] [TRT] Tactic: 57 skipped. Scratch requested: 38371840, available: 16777216
[08/16/2021-04:54:46] [V] [TRT] Fastest Tactic: 6 Time: 16.4196
[08/16/2021-04:54:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6
[08/16/2021-04:54:46] [V] [TRT] 
[08/16/2021-04:54:46] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,4194304) -> Half(1,128,16384,4194304) ***************
[08/16/2021-04:54:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:46] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (CaskConvolution)
[08/16/2021-04:54:46] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (CudaConvolution)
[08/16/2021-04:54:47] [V] [TRT] Tactic: 0 time 31.0167
[08/16/2021-04:54:48] [V] [TRT] Tactic: 1 time 34.9861
[08/16/2021-04:54:48] [V] [TRT] Tactic: 2 skipped. Scratch requested: 75497472, available: 16777216
[08/16/2021-04:54:48] [V] [TRT] Tactic: 4 skipped. Scratch requested: 34765799424, available: 16777216
[08/16/2021-04:54:48] [V] [TRT] Tactic: 5 skipped. Scratch requested: 289669120, available: 16777216
[08/16/2021-04:54:48] [V] [TRT] Tactic: 6 skipped. Scratch requested: 42468864, available: 16777216
[08/16/2021-04:54:48] [V] [TRT] Fastest Tactic: 0 Time: 31.0167
[08/16/2021-04:54:48] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:48] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0
[08/16/2021-04:54:48] [V] [TRT] 
[08/16/2021-04:54:48] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,2097152) -> Half(1,128,16384:2,2097152) ***************
[08/16/2021-04:54:48] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:54:48] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:48] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:48] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:48] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:48] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:54:48] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:48] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:48] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:54:48] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:48] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:48] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (CaskConvolution)
[08/16/2021-04:54:48] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:54:48] [V] [TRT] Tactic: 1145226902788474763 time 12.1783
[08/16/2021-04:54:48] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:48] [V] [TRT] Tactic: 2418518597804310654 time 12.2936
[08/16/2021-04:54:48] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:48] [V] [TRT] Tactic: 8292881859266835088 time 13.0443
[08/16/2021-04:54:48] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:48] [V] [TRT] Tactic: 8401509141903434922 time 12.122
[08/16/2021-04:54:48] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:49] [V] [TRT] Tactic: -8654297089785671176 time 12.0693
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:54:49] [V] [TRT] Tactic: -7448936905981214224 time 13.1836
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:49] [V] [TRT] Tactic: -3689982367035295496 time 12.107
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:49] [V] [TRT] Tactic: -2027588946874785071 time 12.6786
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:54:49] [V] [TRT] Tactic: -245090590808296743 time 12.2888
[08/16/2021-04:54:49] [V] [TRT] Fastest Tactic: -8654297089785671176 Time: 12.0693
[08/16/2021-04:54:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (CudaConvolution)
[08/16/2021-04:54:49] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8654297089785671176
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:49] [V] [TRT] 
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:49] [V] [TRT] *************** Autotuning format combination: Half(32,4096,1:8,524288) -> Float(1,128,16384,4194304) ***************
[08/16/2021-04:54:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (CaskConvolution)
[08/16/2021-04:54:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (CudaConvolution)
[08/16/2021-04:54:49] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:49] [V] [TRT] *************** Autotuning format combination: Half(32,4096,1:8,524288) -> Half(32,4096,1:8,524288) ***************
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (CaskConvolution)
[08/16/2021-04:54:49] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:50] [V] [TRT] Tactic: 3754069740140581927 time 3.78995
[08/16/2021-04:54:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:50] [V] [TRT] Tactic: 5925270497649423688 time 3.63747
[08/16/2021-04:54:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:50] [V] [TRT] Tactic: 6680916730816870145 time 4.06488
[08/16/2021-04:54:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:50] [V] [TRT] Tactic: 7158029511300006471 time 3.89935
[08/16/2021-04:54:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:50] [V] [TRT] Tactic: 7859952145590271433 time 4.06765
[08/16/2021-04:54:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:50] [V] [TRT] Tactic: 8283847742354150423 time 3.76317
[08/16/2021-04:54:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:50] [V] [TRT] Tactic: -4534876761957424274 time 3.77478
[08/16/2021-04:54:50] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:50] [V] [TRT] Tactic: -3237051169894153788 time 3.82376
[08/16/2021-04:54:50] [V] [TRT] Fastest Tactic: 5925270497649423688 Time: 3.63747
[08/16/2021-04:54:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (CudaConvolution)
[08/16/2021-04:54:51] [V] [TRT] Tactic: 0 time 37.2903
[08/16/2021-04:54:51] [V] [TRT] Tactic: 1 skipped. Scratch requested: 16786944, available: 16777216
[08/16/2021-04:54:51] [V] [TRT] Tactic: 2 skipped. Scratch requested: 83886592, available: 16777216
[08/16/2021-04:54:51] [V] [TRT] Tactic: 6 skipped. Scratch requested: 42468864, available: 16777216
[08/16/2021-04:54:51] [V] [TRT] Fastest Tactic: 0 Time: 37.2903
[08/16/2021-04:54:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5925270497649423688
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:51] [V] [TRT] 
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:51] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,2097152) ***************
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:54:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (CaskConvolution)
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:54:51] [V] [TRT] Tactic: 1825138533642645384 time 11.9748
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:54:51] [V] [TRT] Tactic: 2842488832350522458 time 11.8931
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:54:51] [V] [TRT] Tactic: 3915320020053085238 time 11.9316
[08/16/2021-04:54:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:54:52] [V] [TRT] Tactic: 6448355332020552203 time 12.2175
[08/16/2021-04:54:52] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:52] [V] [TRT] Tactic: 6808617066150061604 time 11.933
[08/16/2021-04:54:52] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:54:52] [V] [TRT] Tactic: -8060443123034038864 time 12.0303
[08/16/2021-04:54:52] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:54:52] [V] [TRT] Tactic: -4420849921117327522 time 13.2655
[08/16/2021-04:54:52] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:54:52] [V] [TRT] Tactic: -3946921629105938337 time 14.1206
[08/16/2021-04:54:52] [V] [TRT] Fastest Tactic: 2842488832350522458 Time: 11.8931
[08/16/2021-04:54:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (CudaConvolution)
[08/16/2021-04:54:53] [V] [TRT] Tactic: 0 time 18.5286
[08/16/2021-04:54:53] [V] [TRT] Tactic: 2 skipped. Scratch requested: 37748736, available: 16777216
[08/16/2021-04:54:53] [V] [TRT] Tactic: 5 skipped. Scratch requested: 577110016, available: 16777216
[08/16/2021-04:54:53] [V] [TRT] Tactic: 6 time 8.04842
[08/16/2021-04:54:53] [V] [TRT] Tactic: 57 time 15.8337
[08/16/2021-04:54:53] [V] [TRT] Fastest Tactic: 6 Time: 8.04842
[08/16/2021-04:54:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6
[08/16/2021-04:54:53] [V] [TRT] 
[08/16/2021-04:54:53] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576) -> Half(1,64,4096,2097152) ***************
[08/16/2021-04:54:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:53] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (CaskConvolution)
[08/16/2021-04:54:53] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (CudaConvolution)
[08/16/2021-04:54:54] [V] [TRT] Tactic: 0 time 20.5102
[08/16/2021-04:54:54] [V] [TRT] Tactic: 1 time 13.049
[08/16/2021-04:54:54] [V] [TRT] Tactic: 2 skipped. Scratch requested: 18874368, available: 16777216
[08/16/2021-04:54:54] [V] [TRT] Tactic: 4 skipped. Scratch requested: 17487101952, available: 16777216
[08/16/2021-04:54:54] [V] [TRT] Tactic: 5 skipped. Scratch requested: 577110016, available: 16777216
[08/16/2021-04:54:54] [V] [TRT] Tactic: 6 skipped. Scratch requested: 30411264, available: 16777216
[08/16/2021-04:54:54] [V] [TRT] Fastest Tactic: 1 Time: 13.049
[08/16/2021-04:54:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:54] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:54:54] [V] [TRT] 
[08/16/2021-04:54:54] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288) -> Half(1,64,4096:2,1048576) ***************
[08/16/2021-04:54:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:54:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:54:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:54:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:54] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (CaskConvolution)
[08/16/2021-04:54:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:54:54] [V] [TRT] Tactic: 1145226902788474763 time 6.09559
[08/16/2021-04:54:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:54] [V] [TRT] Tactic: 2418518597804310654 time 6.13767
[08/16/2021-04:54:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:54] [V] [TRT] Tactic: 8292881859266835088 time 6.44518
[08/16/2021-04:54:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:54] [V] [TRT] Tactic: 8401509141903434922 time 6.03173
[08/16/2021-04:54:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:54] [V] [TRT] Tactic: -8654297089785671176 time 6.17671
[08/16/2021-04:54:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:54:54] [V] [TRT] Tactic: -7448936905981214224 time 6.75006
[08/16/2021-04:54:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:55] [V] [TRT] Tactic: -3689982367035295496 time 6.19697
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:55] [V] [TRT] Tactic: -2027588946874785071 time 6.44634
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:54:55] [V] [TRT] Tactic: -245090590808296743 time 6.30334
[08/16/2021-04:54:55] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 6.03173
[08/16/2021-04:54:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (CudaConvolution)
[08/16/2021-04:54:55] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:55] [V] [TRT] 
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:55] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Float(1,64,4096,2097152) ***************
[08/16/2021-04:54:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:55] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (CaskConvolution)
[08/16/2021-04:54:55] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (CudaConvolution)
[08/16/2021-04:54:55] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:55] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Half(64,4096,1:8,262144) ***************
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:55] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (CaskConvolution)
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:55] [V] [TRT] Tactic: 3754069740140581927 time 1.90355
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:55] [V] [TRT] Tactic: 5925270497649423688 time 1.80409
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:55] [V] [TRT] Tactic: 6680916730816870145 time 2.06281
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:55] [V] [TRT] Tactic: 7158029511300006471 time 1.97342
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:55] [V] [TRT] Tactic: 7859952145590271433 time 2.19328
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:55] [V] [TRT] Tactic: 8283847742354150423 time 1.89069
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:55] [V] [TRT] Tactic: -4534876761957424274 time 1.86512
[08/16/2021-04:54:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:55] [V] [TRT] Tactic: -3237051169894153788 time 1.93273
[08/16/2021-04:54:55] [V] [TRT] Fastest Tactic: 5925270497649423688 Time: 1.80409
[08/16/2021-04:54:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (CudaConvolution)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 18.1004
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1 time 13.4754
[08/16/2021-04:54:56] [V] [TRT] Tactic: 2 skipped. Scratch requested: 23069184, available: 16777216
[08/16/2021-04:54:56] [V] [TRT] Tactic: 6 skipped. Scratch requested: 30411264, available: 16777216
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 1 Time: 13.4754
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5925270497649423688
[08/16/2021-04:54:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:56] [V] [TRT] 
[08/16/2021-04:54:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:54:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.441968
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.434184
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.434184
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.747268
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.274716
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.274716
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.555384
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.275196
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.275196
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.510868
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.421432
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.421432
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.750004
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.221632
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.221632
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.557284
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.20326
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.20326
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.97064
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.307632
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.307632
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.975924
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.217568
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.217568
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.552084
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.20568
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.20568
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.57278
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.291188
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.291188
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.559668
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.183464
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.183464
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.822484
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.182332
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.182332
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.01354
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.013676
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 1002 Time: 0.01354
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.032732
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.015444
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.015444
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.023028
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.019496
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.019496
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.01294
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.01832
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 1002 Time: 0.01294
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.03294
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.011432
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.011432
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.023128
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.010496
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.010496
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.035464
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.010652
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.010652
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.035688
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.015584
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.015584
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.023344
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.007688
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.007688
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.022196
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.011272
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.011272
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.023376
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.008856
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.008856
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 1002 time 0.03518
[08/16/2021-04:54:56] [V] [TRT] Tactic: 0 time 0.007544
[08/16/2021-04:54:56] [V] [TRT] Fastest Tactic: 0 Time: 0.007544
[08/16/2021-04:54:56] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,65536) ***************
[08/16/2021-04:54:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:54:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:54:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:54:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:54:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:54:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:54:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:54:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:56] [V] [TRT] Tactic: 524287 time 0.559084
[08/16/2021-04:54:56] [V] [TRT] Tactic: 720895 time 0.554704
[08/16/2021-04:54:57] [V] [TRT] Tactic: 983039 time 0.52916
[08/16/2021-04:54:57] [V] [TRT] Tactic: 1048575 time 0.637288
[08/16/2021-04:54:57] [V] [TRT] Tactic: 1703935 time 0.543536
[08/16/2021-04:54:57] [V] [TRT] Tactic: 1769471 time 0.759724
[08/16/2021-04:54:57] [V] [TRT] Tactic: 1966079 time 0.65216
[08/16/2021-04:54:57] [V] [TRT] Tactic: 2031615 time 0.724736
[08/16/2021-04:54:57] [V] [TRT] Tactic: 2228223 time 0.466008
[08/16/2021-04:54:57] [V] [TRT] Tactic: 2424831 time 0.474044
[08/16/2021-04:54:57] [V] [TRT] Tactic: 2621439 time 0.574916
[08/16/2021-04:54:57] [V] [TRT] Tactic: 2752511 time 0.641236
[08/16/2021-04:54:57] [V] [TRT] Tactic: 2818047 time 0.672392
[08/16/2021-04:54:57] [V] [TRT] Tactic: 2883583 time 0.776868
[08/16/2021-04:54:57] [V] [TRT] Tactic: 3014655 time 0.530756
[08/16/2021-04:54:57] [V] [TRT] Tactic: 3145727 time 0.634264
[08/16/2021-04:54:57] [V] [TRT] Tactic: 3473407 time 0.559352
[08/16/2021-04:54:57] [V] [TRT] Tactic: 3604479 time 0.528192
[08/16/2021-04:54:57] [V] [TRT] Tactic: 3735551 time 0.697492
[08/16/2021-04:54:57] [V] [TRT] Tactic: 4390911 time 0.690728
[08/16/2021-04:54:57] [V] [TRT] Tactic: 5046271 time 0.62806
[08/16/2021-04:54:57] [V] [TRT] Tactic: 5963775 time 0.614352
[08/16/2021-04:54:58] [V] [TRT] Tactic: 6160383 time 0.554308
[08/16/2021-04:54:58] [V] [TRT] Tactic: 6488063 time 0.79902
[08/16/2021-04:54:58] [V] [TRT] Tactic: 6881279 time 0.618428
[08/16/2021-04:54:58] [V] [TRT] Tactic: 7274495 time 0.685664
[08/16/2021-04:54:58] [V] [TRT] Tactic: 7864319 time 0.630804
[08/16/2021-04:54:58] [V] [TRT] Tactic: 7995391 time 0.576176
[08/16/2021-04:54:58] [V] [TRT] Tactic: 8585215 time 0.673744
[08/16/2021-04:54:58] [V] [TRT] Tactic: 8847359 time 0.871496
[08/16/2021-04:54:58] [V] [TRT] Tactic: 8978431 time 0.61108
[08/16/2021-04:54:58] [V] [TRT] Tactic: 9043967 time 0.700672
[08/16/2021-04:54:58] [V] [TRT] Tactic: 9175039 time 0.529112
[08/16/2021-04:54:58] [V] [TRT] Tactic: 9502719 time 0.694392
[08/16/2021-04:54:58] [V] [TRT] Tactic: 9830399 time 0.539752
[08/16/2021-04:54:58] [V] [TRT] Tactic: 9961471 time 0.620724
[08/16/2021-04:54:58] [V] [TRT] Tactic: 10027007 time 0.683224
[08/16/2021-04:54:58] [V] [TRT] Tactic: 10092543 time 0.6911
[08/16/2021-04:54:58] [V] [TRT] Tactic: 10289151 time 0.651924
[08/16/2021-04:54:58] [V] [TRT] Tactic: 10485759 time 0.675956
[08/16/2021-04:54:58] [V] [TRT] Tactic: 10682367 time 0.542964
[08/16/2021-04:54:58] [V] [TRT] Tactic: 10813439 time 0.463108
[08/16/2021-04:54:58] [V] [TRT] Fastest Tactic: 10813439 Time: 0.463108
[08/16/2021-04:54:58] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (CaskConvolution)
[08/16/2021-04:54:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:54:59] [V] [TRT] Tactic: 1825138533642645384 time 0.578084
[08/16/2021-04:54:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:54:59] [V] [TRT] Tactic: 2842488832350522458 time 0.586076
[08/16/2021-04:54:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:54:59] [V] [TRT] Tactic: 3915320020053085238 time 0.556728
[08/16/2021-04:54:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:54:59] [V] [TRT] Tactic: 6448355332020552203 time 0.577684
[08/16/2021-04:54:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:54:59] [V] [TRT] Tactic: 6808617066150061604 time 0.578064
[08/16/2021-04:54:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:54:59] [V] [TRT] Tactic: -8060443123034038864 time 0.610112
[08/16/2021-04:54:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:54:59] [V] [TRT] Tactic: -4420849921117327522 time 0.55424
[08/16/2021-04:54:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:54:59] [V] [TRT] Tactic: -3946921629105938337 time 0.7406
[08/16/2021-04:54:59] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.55424
[08/16/2021-04:54:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (CudaConvolution)
[08/16/2021-04:54:59] [V] [TRT] Tactic: 0 time 0.679396
[08/16/2021-04:54:59] [V] [TRT] Tactic: 2 time 0.669188
[08/16/2021-04:54:59] [V] [TRT] Tactic: 5 skipped. Scratch requested: 287440896, available: 16777216
[08/16/2021-04:54:59] [V] [TRT] Tactic: 6 time 0.414764
[08/16/2021-04:54:59] [V] [TRT] Tactic: 57 time 1.58112
[08/16/2021-04:54:59] [V] [TRT] Fastest Tactic: 6 Time: 0.414764
[08/16/2021-04:54:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6
[08/16/2021-04:54:59] [V] [TRT] 
[08/16/2021-04:54:59] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,131072) -> Half(1,16,256,65536) ***************
[08/16/2021-04:54:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:59] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (CaskConvolution)
[08/16/2021-04:54:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (CudaConvolution)
[08/16/2021-04:54:59] [V] [TRT] Tactic: 0 time 0.8406
[08/16/2021-04:54:59] [V] [TRT] Tactic: 1 time 1.28038
[08/16/2021-04:54:59] [V] [TRT] Tactic: 2 time 0.751332
[08/16/2021-04:54:59] [V] [TRT] Tactic: 4 skipped. Scratch requested: 575012864, available: 16777216
[08/16/2021-04:54:59] [V] [TRT] Tactic: 5 skipped. Scratch requested: 287440896, available: 16777216
[08/16/2021-04:54:59] [V] [TRT] Tactic: 6 time 0.967408
[08/16/2021-04:54:59] [V] [TRT] Fastest Tactic: 2 Time: 0.751332
[08/16/2021-04:54:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:54:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:54:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2
[08/16/2021-04:54:59] [V] [TRT] 
[08/16/2021-04:54:59] [V] [TRT] *************** Autotuning format combination: Half(1,16,256:2,65536) -> Half(1,16,256:2,32768) ***************
[08/16/2021-04:54:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:54:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:54:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:54:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:54:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:54:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:54:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:54:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:54:59] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:54:59] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (FusedConvActConvolution)
[08/16/2021-04:54:59] [V] [TRT] Tactic: 524287 time 0.285608
[08/16/2021-04:54:59] [V] [TRT] Tactic: 720895 time 0.355552
[08/16/2021-04:54:59] [V] [TRT] Tactic: 983039 time 0.287964
[08/16/2021-04:54:59] [V] [TRT] Tactic: 1048575 time 0.30836
[08/16/2021-04:54:59] [V] [TRT] Tactic: 1703935 time 0.274948
[08/16/2021-04:54:59] [V] [TRT] Tactic: 1769471 time 0.39582
[08/16/2021-04:54:59] [V] [TRT] Tactic: 1966079 time 0.336336
[08/16/2021-04:54:59] [V] [TRT] Tactic: 2031615 time 0.364332
[08/16/2021-04:54:59] [V] [TRT] Tactic: 2228223 time 0.238672
[08/16/2021-04:54:59] [V] [TRT] Tactic: 2424831 time 0.244192
[08/16/2021-04:54:59] [V] [TRT] Tactic: 2621439 time 0.291896
[08/16/2021-04:54:59] [V] [TRT] Tactic: 2752511 time 0.393668
[08/16/2021-04:54:59] [V] [TRT] Tactic: 2818047 time 0.341636
[08/16/2021-04:54:59] [V] [TRT] Tactic: 2883583 time 0.392164
[08/16/2021-04:54:59] [V] [TRT] Tactic: 3014655 time 0.27706
[08/16/2021-04:54:59] [V] [TRT] Tactic: 3145727 time 0.338652
[08/16/2021-04:54:59] [V] [TRT] Tactic: 3473407 time 0.281772
[08/16/2021-04:54:59] [V] [TRT] Tactic: 3604479 time 0.276032
[08/16/2021-04:54:59] [V] [TRT] Tactic: 3735551 time 0.323876
[08/16/2021-04:54:59] [V] [TRT] Tactic: 4390911 time 0.354332
[08/16/2021-04:55:00] [V] [TRT] Tactic: 5046271 time 0.309608
[08/16/2021-04:55:00] [V] [TRT] Tactic: 5963775 time 0.310436
[08/16/2021-04:55:00] [V] [TRT] Tactic: 6160383 time 0.278592
[08/16/2021-04:55:00] [V] [TRT] Tactic: 6488063 time 0.394868
[08/16/2021-04:55:00] [V] [TRT] Tactic: 6881279 time 0.31758
[08/16/2021-04:55:00] [V] [TRT] Tactic: 7274495 time 0.343308
[08/16/2021-04:55:00] [V] [TRT] Tactic: 7864319 time 0.33378
[08/16/2021-04:55:00] [V] [TRT] Tactic: 7995391 time 0.230672
[08/16/2021-04:55:00] [V] [TRT] Tactic: 8585215 time 0.34446
[08/16/2021-04:55:00] [V] [TRT] Tactic: 8847359 time 0.463816
[08/16/2021-04:55:00] [V] [TRT] Tactic: 8978431 time 0.308872
[08/16/2021-04:55:00] [V] [TRT] Tactic: 9043967 time 0.363076
[08/16/2021-04:55:00] [V] [TRT] Tactic: 9175039 time 0.278784
[08/16/2021-04:55:00] [V] [TRT] Tactic: 9502719 time 0.353484
[08/16/2021-04:55:00] [V] [TRT] Tactic: 9830399 time 0.275024
[08/16/2021-04:55:00] [V] [TRT] Tactic: 9961471 time 0.322616
[08/16/2021-04:55:00] [V] [TRT] Tactic: 10027007 time 0.37518
[08/16/2021-04:55:00] [V] [TRT] Tactic: 10092543 time 0.354924
[08/16/2021-04:55:00] [V] [TRT] Tactic: 10289151 time 0.336756
[08/16/2021-04:55:00] [V] [TRT] Tactic: 10485759 time 0.345976
[08/16/2021-04:55:00] [V] [TRT] Tactic: 10682367 time 0.286308
[08/16/2021-04:55:00] [V] [TRT] Tactic: 10813439 time 0.240524
[08/16/2021-04:55:00] [V] [TRT] Fastest Tactic: 7995391 Time: 0.230672
[08/16/2021-04:55:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (CaskConvolution)
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:00] [V] [TRT] Tactic: 1145226902788474763 time 0.321108
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:00] [V] [TRT] Tactic: 2418518597804310654 time 0.320656
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:00] [V] [TRT] Tactic: 8292881859266835088 time 0.344764
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:00] [V] [TRT] Tactic: 8401509141903434922 time 0.29832
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:00] [V] [TRT] Tactic: -8654297089785671176 time 0.286344
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:00] [V] [TRT] Tactic: -7448936905981214224 time 0.365684
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:00] [V] [TRT] Tactic: -3689982367035295496 time 0.294724
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:00] [V] [TRT] Tactic: -2027588946874785071 time 0.311016
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:00] [V] [TRT] Tactic: -245090590808296743 time 0.299512
[08/16/2021-04:55:00] [V] [TRT] Fastest Tactic: -8654297089785671176 Time: 0.286344
[08/16/2021-04:55:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (CudaConvolution)
[08/16/2021-04:55:00] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7995391
[08/16/2021-04:55:00] [V] [TRT] 
[08/16/2021-04:55:00] [V] [TRT] *************** Autotuning format combination: Half(64,1024,1:8,16384) -> Float(1,16,256,65536) ***************
[08/16/2021-04:55:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (CaskConvolution)
[08/16/2021-04:55:00] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (CudaConvolution)
[08/16/2021-04:55:00] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:00] [V] [TRT] *************** Autotuning format combination: Half(64,1024,1:8,16384) -> Half(32,512,1:8,8192) ***************
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (CaskConvolution)
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:00] [V] [TRT] Tactic: 3754069740140581927 time 0.124932
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:00] [V] [TRT] Tactic: 5925270497649423688 time 0.1621
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:00] [V] [TRT] Tactic: 6680916730816870145 time 0.098548
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:00] [V] [TRT] Tactic: 7158029511300006471 time 0.122388
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:00] [V] [TRT] Tactic: 7859952145590271433 time 0.098628
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:00] [V] [TRT] Tactic: 8283847742354150423 time 0.126208
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:00] [V] [TRT] Tactic: -4534876761957424274 time 0.161936
[08/16/2021-04:55:00] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:00] [V] [TRT] Tactic: -3237051169894153788 time 0.1201
[08/16/2021-04:55:00] [V] [TRT] Fastest Tactic: 6680916730816870145 Time: 0.098548
[08/16/2021-04:55:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (CudaConvolution)
[08/16/2021-04:55:00] [V] [TRT] Tactic: 0 time 1.33164
[08/16/2021-04:55:00] [V] [TRT] Tactic: 1 time 1.70177
[08/16/2021-04:55:01] [V] [TRT] Tactic: 2 time 0.812052
[08/16/2021-04:55:01] [V] [TRT] Tactic: 6 time 0.956472
[08/16/2021-04:55:01] [V] [TRT] Fastest Tactic: 2 Time: 0.812052
[08/16/2021-04:55:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6680916730816870145
[08/16/2021-04:55:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:01] [V] [TRT] 
[08/16/2021-04:55:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:01] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,65536) ***************
[08/16/2021-04:55:01] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,131072) -> Half(1,16,256,65536) ***************
[08/16/2021-04:55:01] [V] [TRT] *************** Autotuning format combination: Half(1,16,256:2,65536) -> Half(1,16,256:2,32768) ***************
[08/16/2021-04:55:01] [V] [TRT] *************** Autotuning format combination: Half(64,1024,1:8,16384) -> Float(1,16,256,65536) ***************
[08/16/2021-04:55:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_3/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_3/Relu6 (CaskConvolution)
[08/16/2021-04:55:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_3/Relu6 (CudaConvolution)
[08/16/2021-04:55:01] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_3/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:01] [V] [TRT] *************** Autotuning format combination: Half(64,1024,1:8,16384) -> Half(32,512,1:8,8192) ***************
[08/16/2021-04:55:01] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:01] [V] [TRT] Tactic: 1002 time 0.007604
[08/16/2021-04:55:01] [V] [TRT] Tactic: 0 time 0.009468
[08/16/2021-04:55:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.007604
[08/16/2021-04:55:01] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:01] [V] [TRT] Tactic: 1002 time 0.015352
[08/16/2021-04:55:01] [V] [TRT] Tactic: 0 time 0.005856
[08/16/2021-04:55:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005856
[08/16/2021-04:55:01] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:01] [V] [TRT] Tactic: 1002 time 0.010476
[08/16/2021-04:55:01] [V] [TRT] Tactic: 0 time 0.007476
[08/16/2021-04:55:01] [V] [TRT] Fastest Tactic: 0 Time: 0.007476
[08/16/2021-04:55:01] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:01] [V] [TRT] Tactic: 1002 time 0.007492
[08/16/2021-04:55:01] [V] [TRT] Tactic: 0 time 0.007444
[08/16/2021-04:55:01] [V] [TRT] Fastest Tactic: 0 Time: 0.007444
[08/16/2021-04:55:01] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:01] [V] [TRT] Tactic: 1002 time 0.015312
[08/16/2021-04:55:01] [V] [TRT] Tactic: 0 time 0.005692
[08/16/2021-04:55:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005692
[08/16/2021-04:55:01] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:01] [V] [TRT] Tactic: 1002 time 0.01128
[08/16/2021-04:55:01] [V] [TRT] Tactic: 0 time 0.007552
[08/16/2021-04:55:01] [V] [TRT] Fastest Tactic: 0 Time: 0.007552
[08/16/2021-04:55:01] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:01] [V] [TRT] Tactic: 1002 time 0.025156
[08/16/2021-04:55:01] [V] [TRT] Tactic: 0 time 0.005612
[08/16/2021-04:55:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005612
[08/16/2021-04:55:01] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:01] [V] [TRT] Tactic: 1002 time 0.02546
[08/16/2021-04:55:01] [V] [TRT] Tactic: 0 time 0.005616
[08/16/2021-04:55:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005616
[08/16/2021-04:55:01] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:01] [V] [TRT] Tactic: 1002 time 0.0099
[08/16/2021-04:55:01] [V] [TRT] Tactic: 0 time 0.005588
[08/16/2021-04:55:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005588
[08/16/2021-04:55:01] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:01] [V] [TRT] Tactic: 1002 time 0.010756
[08/16/2021-04:55:01] [V] [TRT] Tactic: 0 time 0.00766
[08/16/2021-04:55:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00766
[08/16/2021-04:55:01] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:01] [V] [TRT] Tactic: 1002 time 0.011352
[08/16/2021-04:55:01] [V] [TRT] Tactic: 0 time 0.005544
[08/16/2021-04:55:01] [V] [TRT] Fastest Tactic: 0 Time: 0.005544
[08/16/2021-04:55:01] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:01] [V] [TRT] Tactic: 1002 time 0.01542
[08/16/2021-04:55:01] [V] [TRT] Tactic: 0 time 0.00562
[08/16/2021-04:55:01] [V] [TRT] Fastest Tactic: 0 Time: 0.00562
[08/16/2021-04:55:01] [V] [TRT] *************** Autotuning format combination: Float(1,8,64,16384) -> Float(1,8,64,32768) ***************
[08/16/2021-04:55:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:55:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:55:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:55:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:55:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:55:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:55:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:55:01] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:55:01] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:01] [V] [TRT] Tactic: 524287 time 0.44404
[08/16/2021-04:55:01] [V] [TRT] Tactic: 720895 time 0.542188
[08/16/2021-04:55:01] [V] [TRT] Tactic: 983039 time 0.428012
[08/16/2021-04:55:01] [V] [TRT] Tactic: 1048575 time 0.311852
[08/16/2021-04:55:01] [V] [TRT] Tactic: 1703935 time 0.310548
[08/16/2021-04:55:01] [V] [TRT] Tactic: 1769471 time 0.597656
[08/16/2021-04:55:01] [V] [TRT] Tactic: 1966079 time 0.4828
[08/16/2021-04:55:01] [V] [TRT] Tactic: 2031615 time 0.539336
[08/16/2021-04:55:01] [V] [TRT] Tactic: 2228223 time 0.35394
[08/16/2021-04:55:01] [V] [TRT] Tactic: 2424831 time 0.350148
[08/16/2021-04:55:01] [V] [TRT] Tactic: 2621439 time 0.31242
[08/16/2021-04:55:01] [V] [TRT] Tactic: 2752511 time 0.492672
[08/16/2021-04:55:02] [V] [TRT] Tactic: 2818047 time 0.607256
[08/16/2021-04:55:02] [V] [TRT] Tactic: 2883583 time 0.57906
[08/16/2021-04:55:02] [V] [TRT] Tactic: 3014655 time 0.423788
[08/16/2021-04:55:02] [V] [TRT] Tactic: 3145727 time 0.498136
[08/16/2021-04:55:02] [V] [TRT] Tactic: 3473407 time 0.40114
[08/16/2021-04:55:02] [V] [TRT] Tactic: 3604479 time 0.4227
[08/16/2021-04:55:02] [V] [TRT] Tactic: 3735551 time 0.340336
[08/16/2021-04:55:02] [V] [TRT] Tactic: 4390911 time 0.680952
[08/16/2021-04:55:02] [V] [TRT] Tactic: 5046271 time 0.423848
[08/16/2021-04:55:02] [V] [TRT] Tactic: 5963775 time 0.595284
[08/16/2021-04:55:02] [V] [TRT] Tactic: 6160383 time 0.430384
[08/16/2021-04:55:02] [V] [TRT] Tactic: 6488063 time 0.749188
[08/16/2021-04:55:02] [V] [TRT] Tactic: 6881279 time 0.423816
[08/16/2021-04:55:02] [V] [TRT] Tactic: 7274495 time 0.522192
[08/16/2021-04:55:02] [V] [TRT] Tactic: 7864319 time 0.573016
[08/16/2021-04:55:02] [V] [TRT] Tactic: 7995391 time 0.341224
[08/16/2021-04:55:02] [V] [TRT] Tactic: 8585215 time 0.519952
[08/16/2021-04:55:02] [V] [TRT] Tactic: 8847359 time 0.791804
[08/16/2021-04:55:02] [V] [TRT] Tactic: 8978431 time 0.59542
[08/16/2021-04:55:03] [V] [TRT] Tactic: 9043967 time 0.63906
[08/16/2021-04:55:03] [V] [TRT] Tactic: 9175039 time 0.426928
[08/16/2021-04:55:03] [V] [TRT] Tactic: 9502719 time 0.681688
[08/16/2021-04:55:03] [V] [TRT] Tactic: 9830399 time 0.519452
[08/16/2021-04:55:03] [V] [TRT] Tactic: 9961471 time 0.452992
[08/16/2021-04:55:03] [V] [TRT] Tactic: 10027007 time 0.490012
[08/16/2021-04:55:03] [V] [TRT] Tactic: 10092543 time 0.681292
[08/16/2021-04:55:03] [V] [TRT] Tactic: 10289151 time 0.483204
[08/16/2021-04:55:03] [V] [TRT] Tactic: 10485759 time 0.468412
[08/16/2021-04:55:03] [V] [TRT] Tactic: 10682367 time 0.3018
[08/16/2021-04:55:03] [V] [TRT] Tactic: 10813439 time 0.245344
[08/16/2021-04:55:03] [V] [TRT] Fastest Tactic: 10813439 Time: 0.245344
[08/16/2021-04:55:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (CaskConvolution)
[08/16/2021-04:55:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:55:03] [V] [TRT] Tactic: 1825138533642645384 time 0.565312
[08/16/2021-04:55:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:55:03] [V] [TRT] Tactic: 2842488832350522458 time 0.58914
[08/16/2021-04:55:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:55:03] [V] [TRT] Tactic: 3915320020053085238 time 0.556
[08/16/2021-04:55:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:55:03] [V] [TRT] Tactic: 6448355332020552203 time 0.573392
[08/16/2021-04:55:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:55:03] [V] [TRT] Tactic: 6808617066150061604 time 0.578492
[08/16/2021-04:55:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:55:03] [V] [TRT] Tactic: -8060443123034038864 time 0.610724
[08/16/2021-04:55:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:55:03] [V] [TRT] Tactic: -4420849921117327522 time 0.576856
[08/16/2021-04:55:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:55:03] [V] [TRT] Tactic: -3946921629105938337 time 0.758752
[08/16/2021-04:55:03] [V] [TRT] Fastest Tactic: 3915320020053085238 Time: 0.556
[08/16/2021-04:55:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (CudaConvolution)
[08/16/2021-04:55:03] [V] [TRT] Tactic: 0 time 0.41968
[08/16/2021-04:55:03] [V] [TRT] Tactic: 2 time 0.41752
[08/16/2021-04:55:03] [V] [TRT] Tactic: 5 skipped. Scratch requested: 573767680, available: 16777216
[08/16/2021-04:55:03] [V] [TRT] Tactic: 6 time 0.580792
[08/16/2021-04:55:03] [V] [TRT] Tactic: 57 time 1.25398
[08/16/2021-04:55:03] [V] [TRT] Fastest Tactic: 2 Time: 0.41752
[08/16/2021-04:55:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10813439
[08/16/2021-04:55:03] [V] [TRT] 
[08/16/2021-04:55:03] [V] [TRT] *************** Autotuning format combination: Half(1,8,64,16384) -> Half(1,8,64,32768) ***************
[08/16/2021-04:55:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (CaskConvolution)
[08/16/2021-04:55:03] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (CudaConvolution)
[08/16/2021-04:55:03] [V] [TRT] Tactic: 0 time 0.41048
[08/16/2021-04:55:03] [V] [TRT] Tactic: 1 time 0.788904
[08/16/2021-04:55:03] [V] [TRT] Tactic: 2 time 0.379104
[08/16/2021-04:55:03] [V] [TRT] Tactic: 4 skipped. Scratch requested: 307298304, available: 16777216
[08/16/2021-04:55:03] [V] [TRT] Tactic: 5 skipped. Scratch requested: 573767680, available: 16777216
[08/16/2021-04:55:03] [V] [TRT] Tactic: 6 skipped. Scratch requested: 18024960, available: 16777216
[08/16/2021-04:55:03] [V] [TRT] Fastest Tactic: 2 Time: 0.379104
[08/16/2021-04:55:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2
[08/16/2021-04:55:03] [V] [TRT] 
[08/16/2021-04:55:03] [V] [TRT] *************** Autotuning format combination: Half(1,8,64:2,8192) -> Half(1,8,64:2,16384) ***************
[08/16/2021-04:55:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:03] [V] [TRT] Tactic: 524287 time 0.22146
[08/16/2021-04:55:03] [V] [TRT] Tactic: 720895 time 0.214608
[08/16/2021-04:55:04] [V] [TRT] Tactic: 983039 time 0.221696
[08/16/2021-04:55:04] [V] [TRT] Tactic: 1048575 time 0.161288
[08/16/2021-04:55:04] [V] [TRT] Tactic: 1703935 time 0.162
[08/16/2021-04:55:04] [V] [TRT] Tactic: 1769471 time 0.311284
[08/16/2021-04:55:04] [V] [TRT] Tactic: 1966079 time 0.290524
[08/16/2021-04:55:04] [V] [TRT] Tactic: 2031615 time 0.2721
[08/16/2021-04:55:04] [V] [TRT] Tactic: 2228223 time 0.182672
[08/16/2021-04:55:04] [V] [TRT] Tactic: 2424831 time 0.18246
[08/16/2021-04:55:04] [V] [TRT] Tactic: 2621439 time 0.164232
[08/16/2021-04:55:04] [V] [TRT] Tactic: 2752511 time 0.247856
[08/16/2021-04:55:04] [V] [TRT] Tactic: 2818047 time 0.305412
[08/16/2021-04:55:04] [V] [TRT] Tactic: 2883583 time 0.295428
[08/16/2021-04:55:04] [V] [TRT] Tactic: 3014655 time 0.21344
[08/16/2021-04:55:04] [V] [TRT] Tactic: 3145727 time 0.26438
[08/16/2021-04:55:04] [V] [TRT] Tactic: 3473407 time 0.209852
[08/16/2021-04:55:04] [V] [TRT] Tactic: 3604479 time 0.212592
[08/16/2021-04:55:04] [V] [TRT] Tactic: 3735551 time 0.17078
[08/16/2021-04:55:04] [V] [TRT] Tactic: 4390911 time 0.348768
[08/16/2021-04:55:04] [V] [TRT] Tactic: 5046271 time 0.228652
[08/16/2021-04:55:04] [V] [TRT] Tactic: 5963775 time 0.297828
[08/16/2021-04:55:04] [V] [TRT] Tactic: 6160383 time 0.215352
[08/16/2021-04:55:04] [V] [TRT] Tactic: 6488063 time 0.379868
[08/16/2021-04:55:04] [V] [TRT] Tactic: 6881279 time 0.2148
[08/16/2021-04:55:04] [V] [TRT] Tactic: 7274495 time 0.262844
[08/16/2021-04:55:04] [V] [TRT] Tactic: 7864319 time 0.309156
[08/16/2021-04:55:04] [V] [TRT] Tactic: 7995391 time 0.177296
[08/16/2021-04:55:04] [V] [TRT] Tactic: 8585215 time 0.278444
[08/16/2021-04:55:04] [V] [TRT] Tactic: 8847359 time 0.418848
[08/16/2021-04:55:04] [V] [TRT] Tactic: 8978431 time 0.301368
[08/16/2021-04:55:05] [V] [TRT] Tactic: 9043967 time 0.334004
[08/16/2021-04:55:05] [V] [TRT] Tactic: 9175039 time 0.211844
[08/16/2021-04:55:05] [V] [TRT] Tactic: 9502719 time 0.345388
[08/16/2021-04:55:05] [V] [TRT] Tactic: 9830399 time 0.215728
[08/16/2021-04:55:05] [V] [TRT] Tactic: 9961471 time 0.23778
[08/16/2021-04:55:05] [V] [TRT] Tactic: 10027007 time 0.278776
[08/16/2021-04:55:05] [V] [TRT] Tactic: 10092543 time 0.348688
[08/16/2021-04:55:05] [V] [TRT] Tactic: 10289151 time 0.290512
[08/16/2021-04:55:05] [V] [TRT] Tactic: 10485759 time 0.24544
[08/16/2021-04:55:05] [V] [TRT] Tactic: 10682367 time 0.162852
[08/16/2021-04:55:05] [V] [TRT] Tactic: 10813439 time 0.13102
[08/16/2021-04:55:05] [V] [TRT] Fastest Tactic: 10813439 Time: 0.13102
[08/16/2021-04:55:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (CaskConvolution)
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:05] [V] [TRT] Tactic: 1145226902788474763 time 0.327528
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:05] [V] [TRT] Tactic: 2418518597804310654 time 0.323324
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:05] [V] [TRT] Tactic: 8292881859266835088 time 0.347608
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:05] [V] [TRT] Tactic: 8401509141903434922 time 0.30256
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:05] [V] [TRT] Tactic: -8654297089785671176 time 0.286148
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:05] [V] [TRT] Tactic: -7448936905981214224 time 0.366552
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:05] [V] [TRT] Tactic: -3689982367035295496 time 0.29004
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:05] [V] [TRT] Tactic: -2027588946874785071 time 0.313288
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:05] [V] [TRT] Tactic: -245090590808296743 time 0.298472
[08/16/2021-04:55:05] [V] [TRT] Fastest Tactic: -8654297089785671176 Time: 0.286148
[08/16/2021-04:55:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (CudaConvolution)
[08/16/2021-04:55:05] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10813439
[08/16/2021-04:55:05] [V] [TRT] 
[08/16/2021-04:55:05] [V] [TRT] *************** Autotuning format combination: Half(32,256,1:8,2048) -> Float(1,8,64,32768) ***************
[08/16/2021-04:55:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (CaskConvolution)
[08/16/2021-04:55:05] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (CudaConvolution)
[08/16/2021-04:55:05] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:05] [V] [TRT] *************** Autotuning format combination: Half(32,256,1:8,2048) -> Half(64,512,1:8,4096) ***************
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (CaskConvolution)
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] Tactic: 3754069740140581927 time 0.124704
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] Tactic: 5925270497649423688 time 0.156768
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] Tactic: 6680916730816870145 time 0.178992
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] Tactic: 7158029511300006471 time 0.163012
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] Tactic: 7859952145590271433 time 0.179924
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] Tactic: 8283847742354150423 time 0.12372
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] Tactic: -4534876761957424274 time 0.156276
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] Tactic: -3237051169894153788 time 0.16048
[08/16/2021-04:55:05] [V] [TRT] Fastest Tactic: 8283847742354150423 Time: 0.12372
[08/16/2021-04:55:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (CudaConvolution)
[08/16/2021-04:55:05] [V] [TRT] Tactic: 0 time 11.3597
[08/16/2021-04:55:05] [V] [TRT] Tactic: 1 time 1.0653
[08/16/2021-04:55:05] [V] [TRT] Tactic: 2 time 0.371104
[08/16/2021-04:55:05] [V] [TRT] Tactic: 6 skipped. Scratch requested: 18024960, available: 16777216
[08/16/2021-04:55:05] [V] [TRT] Fastest Tactic: 2 Time: 0.371104
[08/16/2021-04:55:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8283847742354150423
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] 
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:05] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:05] [V] [TRT] Tactic: 1002 time 0.008716
[08/16/2021-04:55:05] [V] [TRT] Tactic: 0 time 0.01144
[08/16/2021-04:55:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.008716
[08/16/2021-04:55:05] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:05] [V] [TRT] Tactic: 1002 time 0.020824
[08/16/2021-04:55:05] [V] [TRT] Tactic: 0 time 0.007604
[08/16/2021-04:55:05] [V] [TRT] Fastest Tactic: 0 Time: 0.007604
[08/16/2021-04:55:05] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:05] [V] [TRT] Tactic: 1002 time 0.015552
[08/16/2021-04:55:05] [V] [TRT] Tactic: 0 time 0.009556
[08/16/2021-04:55:05] [V] [TRT] Fastest Tactic: 0 Time: 0.009556
[08/16/2021-04:55:05] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:05] [V] [TRT] Tactic: 1002 time 0.009556
[08/16/2021-04:55:05] [V] [TRT] Tactic: 0 time 0.011476
[08/16/2021-04:55:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.009556
[08/16/2021-04:55:05] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:05] [V] [TRT] Tactic: 1002 time 0.021224
[08/16/2021-04:55:05] [V] [TRT] Tactic: 0 time 0.00766
[08/16/2021-04:55:05] [V] [TRT] Fastest Tactic: 0 Time: 0.00766
[08/16/2021-04:55:05] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:06] [V] [TRT] Tactic: 1002 time 0.015408
[08/16/2021-04:55:06] [V] [TRT] Tactic: 0 time 0.008916
[08/16/2021-04:55:06] [V] [TRT] Fastest Tactic: 0 Time: 0.008916
[08/16/2021-04:55:06] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:06] [V] [TRT] Tactic: 1002 time 0.045024
[08/16/2021-04:55:06] [V] [TRT] Tactic: 0 time 0.00766
[08/16/2021-04:55:06] [V] [TRT] Fastest Tactic: 0 Time: 0.00766
[08/16/2021-04:55:06] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:06] [V] [TRT] Tactic: 1002 time 0.044252
[08/16/2021-04:55:06] [V] [TRT] Tactic: 0 time 0.008152
[08/16/2021-04:55:06] [V] [TRT] Fastest Tactic: 0 Time: 0.008152
[08/16/2021-04:55:06] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:06] [V] [TRT] Tactic: 1002 time 0.015488
[08/16/2021-04:55:06] [V] [TRT] Tactic: 0 time 0.005636
[08/16/2021-04:55:06] [V] [TRT] Fastest Tactic: 0 Time: 0.005636
[08/16/2021-04:55:06] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:06] [V] [TRT] Tactic: 1002 time 0.015428
[08/16/2021-04:55:06] [V] [TRT] Tactic: 0 time 0.007532
[08/16/2021-04:55:06] [V] [TRT] Fastest Tactic: 0 Time: 0.007532
[08/16/2021-04:55:06] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:06] [V] [TRT] Tactic: 1002 time 0.015408
[08/16/2021-04:55:06] [V] [TRT] Tactic: 0 time 0.007592
[08/16/2021-04:55:06] [V] [TRT] Fastest Tactic: 0 Time: 0.007592
[08/16/2021-04:55:06] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:06] [V] [TRT] Tactic: 1002 time 0.021872
[08/16/2021-04:55:06] [V] [TRT] Tactic: 0 time 0.006344
[08/16/2021-04:55:06] [V] [TRT] Fastest Tactic: 0 Time: 0.006344
[08/16/2021-04:55:06] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) ***************
[08/16/2021-04:55:06] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:55:06] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:55:06] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:55:06] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:55:06] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:55:06] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:55:06] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:55:06] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:55:06] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:06] [V] [TRT] Tactic: 524287 time 1.87724
[08/16/2021-04:55:06] [V] [TRT] Tactic: 720895 time 2.3591
[08/16/2021-04:55:06] [V] [TRT] Tactic: 983039 time 1.79724
[08/16/2021-04:55:06] [V] [TRT] Tactic: 1048575 time 1.95512
[08/16/2021-04:55:06] [V] [TRT] Tactic: 1703935 time 2.3558
[08/16/2021-04:55:06] [V] [TRT] Tactic: 1769471 time 2.53232
[08/16/2021-04:55:07] [V] [TRT] Tactic: 1966079 time 1.91614
[08/16/2021-04:55:07] [V] [TRT] Tactic: 2031615 time 2.49858
[08/16/2021-04:55:07] [V] [TRT] Tactic: 2228223 time 2.10931
[08/16/2021-04:55:07] [V] [TRT] Tactic: 2424831 time 1.87278
[08/16/2021-04:55:07] [V] [TRT] Tactic: 2621439 time 2.03734
[08/16/2021-04:55:07] [V] [TRT] Tactic: 2752511 time 2.04743
[08/16/2021-04:55:07] [V] [TRT] Tactic: 2818047 time 2.31385
[08/16/2021-04:55:07] [V] [TRT] Tactic: 2883583 time 2.07968
[08/16/2021-04:55:07] [V] [TRT] Tactic: 3014655 time 1.90742
[08/16/2021-04:55:08] [V] [TRT] Tactic: 3145727 time 1.99957
[08/16/2021-04:55:08] [V] [TRT] Tactic: 3473407 time 2.11698
[08/16/2021-04:55:08] [V] [TRT] Tactic: 3604479 time 1.86797
[08/16/2021-04:55:08] [V] [TRT] Tactic: 3735551 time 2.382
[08/16/2021-04:55:08] [V] [TRT] Tactic: 4390911 time 2.071
[08/16/2021-04:55:08] [V] [TRT] Tactic: 5046271 time 2.10197
[08/16/2021-04:55:08] [V] [TRT] Tactic: 5963775 time 2.18328
[08/16/2021-04:55:08] [V] [TRT] Tactic: 6160383 time 2.18784
[08/16/2021-04:55:09] [V] [TRT] Tactic: 6488063 time 2.20133
[08/16/2021-04:55:09] [V] [TRT] Tactic: 6881279 time 2.00118
[08/16/2021-04:55:09] [V] [TRT] Tactic: 7274495 time 2.29028
[08/16/2021-04:55:09] [V] [TRT] Tactic: 7864319 time 2.28518
[08/16/2021-04:55:09] [V] [TRT] Tactic: 7995391 time 1.80043
[08/16/2021-04:55:09] [V] [TRT] Tactic: 8585215 time 2.26927
[08/16/2021-04:55:09] [V] [TRT] Tactic: 8847359 time 2.63624
[08/16/2021-04:55:09] [V] [TRT] Tactic: 8978431 time 1.93
[08/16/2021-04:55:10] [V] [TRT] Tactic: 9043967 time 2.07578
[08/16/2021-04:55:10] [V] [TRT] Tactic: 9175039 time 1.91923
[08/16/2021-04:55:10] [V] [TRT] Tactic: 9502719 time 2.26768
[08/16/2021-04:55:10] [V] [TRT] Tactic: 9830399 time 2.03081
[08/16/2021-04:55:10] [V] [TRT] Tactic: 9961471 time 2.27204
[08/16/2021-04:55:10] [V] [TRT] Tactic: 10027007 time 2.27859
[08/16/2021-04:55:10] [V] [TRT] Tactic: 10092543 time 2.15115
[08/16/2021-04:55:10] [V] [TRT] Tactic: 10289151 time 1.8606
[08/16/2021-04:55:11] [V] [TRT] Tactic: 10485759 time 2.33775
[08/16/2021-04:55:11] [V] [TRT] Tactic: 10682367 time 1.86678
[08/16/2021-04:55:11] [V] [TRT] Tactic: 10813439 time 1.67067
[08/16/2021-04:55:11] [V] [TRT] Fastest Tactic: 10813439 Time: 1.67067
[08/16/2021-04:55:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (CaskConvolution)
[08/16/2021-04:55:11] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:55:11] [V] [TRT] Tactic: 1825138533642645384 time 1.85309
[08/16/2021-04:55:11] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:55:11] [V] [TRT] Tactic: 2842488832350522458 time 1.77857
[08/16/2021-04:55:11] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:55:11] [V] [TRT] Tactic: 3915320020053085238 time 1.92904
[08/16/2021-04:55:11] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:55:11] [V] [TRT] Tactic: 6448355332020552203 time 1.88623
[08/16/2021-04:55:11] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:55:11] [V] [TRT] Tactic: 6808617066150061604 time 1.73682
[08/16/2021-04:55:11] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:55:11] [V] [TRT] Tactic: -8060443123034038864 time 1.9849
[08/16/2021-04:55:11] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:55:11] [V] [TRT] Tactic: -4420849921117327522 time 1.89869
[08/16/2021-04:55:11] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:55:11] [V] [TRT] Tactic: -3946921629105938337 time 2.2936
[08/16/2021-04:55:11] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 1.73682
[08/16/2021-04:55:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (CudaConvolution)
[08/16/2021-04:55:11] [V] [TRT] Tactic: 0 time 2.62706
[08/16/2021-04:55:11] [V] [TRT] Tactic: 2 time 2.56814
[08/16/2021-04:55:11] [V] [TRT] Tactic: 5 skipped. Scratch requested: 289669120, available: 16777216
[08/16/2021-04:55:11] [V] [TRT] Tactic: 6 time 1.23427
[08/16/2021-04:55:11] [V] [TRT] Tactic: 57 time 2.47867
[08/16/2021-04:55:11] [V] [TRT] Fastest Tactic: 6 Time: 1.23427
[08/16/2021-04:55:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6
[08/16/2021-04:55:11] [V] [TRT] 
[08/16/2021-04:55:11] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144) -> Half(1,32,1024,262144) ***************
[08/16/2021-04:55:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (CaskConvolution)
[08/16/2021-04:55:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (CudaConvolution)
[08/16/2021-04:55:11] [V] [TRT] Tactic: 0 time 2.78223
[08/16/2021-04:55:11] [V] [TRT] Tactic: 1 time 3.33662
[08/16/2021-04:55:11] [V] [TRT] Tactic: 2 time 2.58384
[08/16/2021-04:55:11] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2225602560, available: 16777216
[08/16/2021-04:55:11] [V] [TRT] Tactic: 5 skipped. Scratch requested: 289669120, available: 16777216
[08/16/2021-04:55:12] [V] [TRT] Tactic: 6 time 1.40904
[08/16/2021-04:55:12] [V] [TRT] Fastest Tactic: 6 Time: 1.40904
[08/16/2021-04:55:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6
[08/16/2021-04:55:12] [V] [TRT] 
[08/16/2021-04:55:12] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072) -> Half(1,32,1024:2,131072) ***************
[08/16/2021-04:55:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:12] [V] [TRT] Tactic: 524287 time 0.947528
[08/16/2021-04:55:12] [V] [TRT] Tactic: 720895 time 1.16064
[08/16/2021-04:55:12] [V] [TRT] Tactic: 983039 time 0.98142
[08/16/2021-04:55:12] [V] [TRT] Tactic: 1048575 time 0.97134
[08/16/2021-04:55:12] [V] [TRT] Tactic: 1703935 time 0.931264
[08/16/2021-04:55:12] [V] [TRT] Tactic: 1769471 time 1.18083
[08/16/2021-04:55:12] [V] [TRT] Tactic: 1966079 time 0.956332
[08/16/2021-04:55:12] [V] [TRT] Tactic: 2031615 time 1.16821
[08/16/2021-04:55:12] [V] [TRT] Tactic: 2228223 time 0.942956
[08/16/2021-04:55:12] [V] [TRT] Tactic: 2424831 time 0.99854
[08/16/2021-04:55:12] [V] [TRT] Tactic: 2621439 time 0.996188
[08/16/2021-04:55:12] [V] [TRT] Tactic: 2752511 time 1.10792
[08/16/2021-04:55:12] [V] [TRT] Tactic: 2818047 time 1.07296
[08/16/2021-04:55:13] [V] [TRT] Tactic: 2883583 time 1.01582
[08/16/2021-04:55:13] [V] [TRT] Tactic: 3014655 time 0.886496
[08/16/2021-04:55:13] [V] [TRT] Tactic: 3145727 time 1.07929
[08/16/2021-04:55:13] [V] [TRT] Tactic: 3473407 time 0.973044
[08/16/2021-04:55:13] [V] [TRT] Tactic: 3604479 time 0.885536
[08/16/2021-04:55:13] [V] [TRT] Tactic: 3735551 time 1.02514
[08/16/2021-04:55:13] [V] [TRT] Tactic: 4390911 time 0.999696
[08/16/2021-04:55:13] [V] [TRT] Tactic: 5046271 time 1.0839
[08/16/2021-04:55:13] [V] [TRT] Tactic: 5963775 time 1.01989
[08/16/2021-04:55:13] [V] [TRT] Tactic: 6160383 time 0.945736
[08/16/2021-04:55:13] [V] [TRT] Tactic: 6488063 time 1.0464
[08/16/2021-04:55:13] [V] [TRT] Tactic: 6881279 time 1.00388
[08/16/2021-04:55:13] [V] [TRT] Tactic: 7274495 time 1.11206
[08/16/2021-04:55:13] [V] [TRT] Tactic: 7864319 time 1.10025
[08/16/2021-04:55:13] [V] [TRT] Tactic: 7995391 time 0.89052
[08/16/2021-04:55:13] [V] [TRT] Tactic: 8585215 time 1.00416
[08/16/2021-04:55:14] [V] [TRT] Tactic: 8847359 time 1.28496
[08/16/2021-04:55:14] [V] [TRT] Tactic: 8978431 time 1.03861
[08/16/2021-04:55:14] [V] [TRT] Tactic: 9043967 time 0.984392
[08/16/2021-04:55:14] [V] [TRT] Tactic: 9175039 time 0.88582
[08/16/2021-04:55:14] [V] [TRT] Tactic: 9502719 time 0.988548
[08/16/2021-04:55:14] [V] [TRT] Tactic: 9830399 time 0.939868
[08/16/2021-04:55:14] [V] [TRT] Tactic: 9961471 time 1.07177
[08/16/2021-04:55:14] [V] [TRT] Tactic: 10027007 time 0.995804
[08/16/2021-04:55:14] [V] [TRT] Tactic: 10092543 time 0.995628
[08/16/2021-04:55:14] [V] [TRT] Tactic: 10289151 time 0.91334
[08/16/2021-04:55:14] [V] [TRT] Tactic: 10485759 time 1.05761
[08/16/2021-04:55:14] [V] [TRT] Tactic: 10682367 time 0.9853
[08/16/2021-04:55:14] [V] [TRT] Tactic: 10813439 time 0.843988
[08/16/2021-04:55:14] [V] [TRT] Fastest Tactic: 10813439 Time: 0.843988
[08/16/2021-04:55:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (CaskConvolution)
[08/16/2021-04:55:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:14] [V] [TRT] Tactic: 1145226902788474763 time 0.881332
[08/16/2021-04:55:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:14] [V] [TRT] Tactic: 2418518597804310654 time 0.877212
[08/16/2021-04:55:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:14] [V] [TRT] Tactic: 8292881859266835088 time 0.896172
[08/16/2021-04:55:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:14] [V] [TRT] Tactic: 8401509141903434922 time 0.856204
[08/16/2021-04:55:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:14] [V] [TRT] Tactic: -8654297089785671176 time 0.848016
[08/16/2021-04:55:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:14] [V] [TRT] Tactic: -7448936905981214224 time 0.913188
[08/16/2021-04:55:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:14] [V] [TRT] Tactic: -3689982367035295496 time 0.859144
[08/16/2021-04:55:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:14] [V] [TRT] Tactic: -2027588946874785071 time 0.877056
[08/16/2021-04:55:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:14] [V] [TRT] Tactic: -245090590808296743 time 0.873696
[08/16/2021-04:55:14] [V] [TRT] Fastest Tactic: -8654297089785671176 Time: 0.848016
[08/16/2021-04:55:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (CudaConvolution)
[08/16/2021-04:55:14] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10813439
[08/16/2021-04:55:14] [V] [TRT] 
[08/16/2021-04:55:14] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Float(1,32,1024,262144) ***************
[08/16/2021-04:55:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:14] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (CaskConvolution)
[08/16/2021-04:55:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (CudaConvolution)
[08/16/2021-04:55:14] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:14] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Half(32,1024,1:8,32768) ***************
[08/16/2021-04:55:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:14] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (CaskConvolution)
[08/16/2021-04:55:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:14] [V] [TRT] Tactic: 3754069740140581927 time 0.30778
[08/16/2021-04:55:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:15] [V] [TRT] Tactic: 5925270497649423688 time 0.322496
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:15] [V] [TRT] Tactic: 6680916730816870145 time 0.291528
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:15] [V] [TRT] Tactic: 7158029511300006471 time 0.306908
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:15] [V] [TRT] Tactic: 7859952145590271433 time 0.29406
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:15] [V] [TRT] Tactic: 8283847742354150423 time 0.303212
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:15] [V] [TRT] Tactic: -4534876761957424274 time 0.33102
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:15] [V] [TRT] Tactic: -3237051169894153788 time 0.301004
[08/16/2021-04:55:15] [V] [TRT] Fastest Tactic: 6680916730816870145 Time: 0.291528
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (CudaConvolution)
[08/16/2021-04:55:15] [V] [TRT] Tactic: 0 time 4.8477
[08/16/2021-04:55:15] [V] [TRT] Tactic: 1 time 2.3417
[08/16/2021-04:55:15] [V] [TRT] Tactic: 2 time 2.57404
[08/16/2021-04:55:15] [V] [TRT] Tactic: 6 time 1.25629
[08/16/2021-04:55:15] [V] [TRT] Fastest Tactic: 6 Time: 1.25629
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6680916730816870145
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:15] [V] [TRT] 
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) ***************
[08/16/2021-04:55:15] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144) -> Half(1,32,1024,262144) ***************
[08/16/2021-04:55:15] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072) -> Half(1,32,1024:2,131072) ***************
[08/16/2021-04:55:15] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Float(1,32,1024,262144) ***************
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_2/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_2/Relu6 (CaskConvolution)
[08/16/2021-04:55:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_2/Relu6 (CudaConvolution)
[08/16/2021-04:55:15] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_2/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:15] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Half(32,1024,1:8,32768) ***************
[08/16/2021-04:55:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) ***************
[08/16/2021-04:55:15] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144) -> Half(1,32,1024,262144) ***************
[08/16/2021-04:55:15] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072) -> Half(1,32,1024:2,131072) ***************
[08/16/2021-04:55:15] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Float(1,32,1024,262144) ***************
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_2/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_2/Relu6 (CaskConvolution)
[08/16/2021-04:55:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_2/Relu6 (CudaConvolution)
[08/16/2021-04:55:15] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_2/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:15] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Half(32,1024,1:8,32768) ***************
[08/16/2021-04:55:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) ***************
[08/16/2021-04:55:15] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144) -> Half(1,32,1024,262144) ***************
[08/16/2021-04:55:15] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072) -> Half(1,32,1024:2,131072) ***************
[08/16/2021-04:55:15] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Float(1,32,1024,262144) ***************
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_2/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_2/Relu6 (CaskConvolution)
[08/16/2021-04:55:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_2/Relu6 (CudaConvolution)
[08/16/2021-04:55:15] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_2/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:15] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Half(32,1024,1:8,32768) ***************
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:15] [V] [TRT] Tactic: 1002 time 0.007672
[08/16/2021-04:55:15] [V] [TRT] Tactic: 0 time 0.007628
[08/16/2021-04:55:15] [V] [TRT] Fastest Tactic: 0 Time: 0.007628
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:15] [V] [TRT] Tactic: 1002 time 0.014944
[08/16/2021-04:55:15] [V] [TRT] Tactic: 0 time 0.007628
[08/16/2021-04:55:15] [V] [TRT] Fastest Tactic: 0 Time: 0.007628
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:15] [V] [TRT] Tactic: 1002 time 0.009872
[08/16/2021-04:55:15] [V] [TRT] Tactic: 0 time 0.009568
[08/16/2021-04:55:15] [V] [TRT] Fastest Tactic: 0 Time: 0.009568
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:15] [V] [TRT] Tactic: 1002 time 0.007468
[08/16/2021-04:55:15] [V] [TRT] Tactic: 0 time 0.007596
[08/16/2021-04:55:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.007468
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:15] [V] [TRT] Tactic: 1002 time 0.015288
[08/16/2021-04:55:15] [V] [TRT] Tactic: 0 time 0.005564
[08/16/2021-04:55:15] [V] [TRT] Fastest Tactic: 0 Time: 0.005564
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:15] [V] [TRT] Tactic: 1002 time 0.010708
[08/16/2021-04:55:15] [V] [TRT] Tactic: 0 time 0.007704
[08/16/2021-04:55:15] [V] [TRT] Fastest Tactic: 0 Time: 0.007704
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:15] [V] [TRT] Tactic: 1002 time 0.025376
[08/16/2021-04:55:15] [V] [TRT] Tactic: 0 time 0.005652
[08/16/2021-04:55:15] [V] [TRT] Fastest Tactic: 0 Time: 0.005652
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:15] [V] [TRT] Tactic: 1002 time 0.025184
[08/16/2021-04:55:15] [V] [TRT] Tactic: 0 time 0.0076
[08/16/2021-04:55:15] [V] [TRT] Fastest Tactic: 0 Time: 0.0076
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:15] [V] [TRT] Tactic: 1002 time 0.010728
[08/16/2021-04:55:15] [V] [TRT] Tactic: 0 time 0.005792
[08/16/2021-04:55:15] [V] [TRT] Fastest Tactic: 0 Time: 0.005792
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:15] [V] [TRT] Tactic: 1002 time 0.010348
[08/16/2021-04:55:15] [V] [TRT] Tactic: 0 time 0.007636
[08/16/2021-04:55:15] [V] [TRT] Fastest Tactic: 0 Time: 0.007636
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:15] [V] [TRT] Tactic: 1002 time 0.010988
[08/16/2021-04:55:15] [V] [TRT] Tactic: 0 time 0.005652
[08/16/2021-04:55:15] [V] [TRT] Fastest Tactic: 0 Time: 0.005652
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:15] [V] [TRT] Tactic: 1002 time 0.015456
[08/16/2021-04:55:15] [V] [TRT] Tactic: 0 time 0.005548
[08/16/2021-04:55:15] [V] [TRT] Fastest Tactic: 0 Time: 0.005548
[08/16/2021-04:55:15] [V] [TRT] *************** Autotuning format combination: Float(1,8,64,32768) -> Float(1,8,64,16384) ***************
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:55:15] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:55:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:15] [V] [TRT] Tactic: 524287 time 0.318732
[08/16/2021-04:55:15] [V] [TRT] Tactic: 720895 time 0.31826
[08/16/2021-04:55:15] [V] [TRT] Tactic: 983039 time 0.212048
[08/16/2021-04:55:15] [V] [TRT] Tactic: 1048575 time 0.215836
[08/16/2021-04:55:15] [V] [TRT] Tactic: 1703935 time 0.1635
[08/16/2021-04:55:15] [V] [TRT] Tactic: 1769471 time 0.288616
[08/16/2021-04:55:15] [V] [TRT] Tactic: 1966079 time 0.469936
[08/16/2021-04:55:15] [V] [TRT] Tactic: 2031615 time 0.412296
[08/16/2021-04:55:15] [V] [TRT] Tactic: 2228223 time 0.257464
[08/16/2021-04:55:15] [V] [TRT] Tactic: 2424831 time 0.183892
[08/16/2021-04:55:16] [V] [TRT] Tactic: 2621439 time 0.16762
[08/16/2021-04:55:16] [V] [TRT] Tactic: 2752511 time 0.344852
[08/16/2021-04:55:16] [V] [TRT] Tactic: 2818047 time 0.339988
[08/16/2021-04:55:16] [V] [TRT] Tactic: 2883583 time 0.569576
[08/16/2021-04:55:16] [V] [TRT] Tactic: 3014655 time 0.207992
[08/16/2021-04:55:16] [V] [TRT] Tactic: 3145727 time 0.252888
[08/16/2021-04:55:16] [V] [TRT] Tactic: 3473407 time 0.297464
[08/16/2021-04:55:16] [V] [TRT] Tactic: 3604479 time 0.205672
[08/16/2021-04:55:16] [V] [TRT] Tactic: 3735551 time 0.27726
[08/16/2021-04:55:16] [V] [TRT] Tactic: 4390911 time 0.500112
[08/16/2021-04:55:16] [V] [TRT] Tactic: 5046271 time 0.2246
[08/16/2021-04:55:16] [V] [TRT] Tactic: 5963775 time 0.440768
[08/16/2021-04:55:16] [V] [TRT] Tactic: 6160383 time 0.305764
[08/16/2021-04:55:16] [V] [TRT] Tactic: 6488063 time 0.457568
[08/16/2021-04:55:16] [V] [TRT] Tactic: 6881279 time 0.385176
[08/16/2021-04:55:16] [V] [TRT] Tactic: 7274495 time 0.23262
[08/16/2021-04:55:16] [V] [TRT] Tactic: 7864319 time 0.315076
[08/16/2021-04:55:16] [V] [TRT] Tactic: 7995391 time 0.319192
[08/16/2021-04:55:16] [V] [TRT] Tactic: 8585215 time 0.353316
[08/16/2021-04:55:16] [V] [TRT] Tactic: 8847359 time 0.428748
[08/16/2021-04:55:16] [V] [TRT] Tactic: 8978431 time 0.441308
[08/16/2021-04:55:16] [V] [TRT] Tactic: 9043967 time 0.369768
[08/16/2021-04:55:16] [V] [TRT] Tactic: 9175039 time 0.206716
[08/16/2021-04:55:16] [V] [TRT] Tactic: 9502719 time 0.50018
[08/16/2021-04:55:16] [V] [TRT] Tactic: 9830399 time 0.305816
[08/16/2021-04:55:16] [V] [TRT] Tactic: 9961471 time 0.23088
[08/16/2021-04:55:16] [V] [TRT] Tactic: 10027007 time 0.271484
[08/16/2021-04:55:17] [V] [TRT] Tactic: 10092543 time 0.500096
[08/16/2021-04:55:17] [V] [TRT] Tactic: 10289151 time 0.47114
[08/16/2021-04:55:17] [V] [TRT] Tactic: 10485759 time 0.253232
[08/16/2021-04:55:17] [V] [TRT] Tactic: 10682367 time 0.15992
[08/16/2021-04:55:17] [V] [TRT] Tactic: 10813439 time 0.173396
[08/16/2021-04:55:17] [V] [TRT] Fastest Tactic: 10682367 Time: 0.15992
[08/16/2021-04:55:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (CaskConvolution)
[08/16/2021-04:55:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:55:17] [V] [TRT] Tactic: 1825138533642645384 time 0.564708
[08/16/2021-04:55:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:55:17] [V] [TRT] Tactic: 2842488832350522458 time 0.437152
[08/16/2021-04:55:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:55:17] [V] [TRT] Tactic: 3915320020053085238 time 0.55426
[08/16/2021-04:55:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:55:17] [V] [TRT] Tactic: 6448355332020552203 time 0.5731
[08/16/2021-04:55:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:55:17] [V] [TRT] Tactic: 6808617066150061604 time 0.397936
[08/16/2021-04:55:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:55:17] [V] [TRT] Tactic: -8060443123034038864 time 0.4509
[08/16/2021-04:55:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:55:17] [V] [TRT] Tactic: -4420849921117327522 time 0.536528
[08/16/2021-04:55:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:55:17] [V] [TRT] Tactic: -3946921629105938337 time 0.597856
[08/16/2021-04:55:17] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.397936
[08/16/2021-04:55:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (CudaConvolution)
[08/16/2021-04:55:17] [V] [TRT] Tactic: 0 time 0.29744
[08/16/2021-04:55:17] [V] [TRT] Tactic: 2 time 0.3436
[08/16/2021-04:55:17] [V] [TRT] Tactic: 5 skipped. Scratch requested: 287440896, available: 16777216
[08/16/2021-04:55:17] [V] [TRT] Tactic: 6 time 0.329696
[08/16/2021-04:55:17] [V] [TRT] Tactic: 57 time 1.02761
[08/16/2021-04:55:17] [V] [TRT] Fastest Tactic: 0 Time: 0.29744
[08/16/2021-04:55:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10682367
[08/16/2021-04:55:17] [V] [TRT] 
[08/16/2021-04:55:17] [V] [TRT] *************** Autotuning format combination: Half(1,8,64,32768) -> Half(1,8,64,16384) ***************
[08/16/2021-04:55:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:17] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (CaskConvolution)
[08/16/2021-04:55:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (CudaConvolution)
[08/16/2021-04:55:17] [V] [TRT] Tactic: 0 time 0.358016
[08/16/2021-04:55:17] [V] [TRT] Tactic: 1 time 0.764756
[08/16/2021-04:55:17] [V] [TRT] Tactic: 2 time 0.303844
[08/16/2021-04:55:17] [V] [TRT] Tactic: 4 skipped. Scratch requested: 153944064, available: 16777216
[08/16/2021-04:55:17] [V] [TRT] Tactic: 5 skipped. Scratch requested: 287440896, available: 16777216
[08/16/2021-04:55:17] [V] [TRT] Tactic: 6 time 0.601744
[08/16/2021-04:55:17] [V] [TRT] Fastest Tactic: 2 Time: 0.303844
[08/16/2021-04:55:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2
[08/16/2021-04:55:17] [V] [TRT] 
[08/16/2021-04:55:17] [V] [TRT] *************** Autotuning format combination: Half(1,8,64:2,16384) -> Half(1,8,64:2,8192) ***************
[08/16/2021-04:55:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:17] [V] [TRT] Tactic: 524287 time 0.162964
[08/16/2021-04:55:17] [V] [TRT] Tactic: 720895 time 0.161588
[08/16/2021-04:55:17] [V] [TRT] Tactic: 983039 time 0.110476
[08/16/2021-04:55:17] [V] [TRT] Tactic: 1048575 time 0.11394
[08/16/2021-04:55:17] [V] [TRT] Tactic: 1703935 time 0.088512
[08/16/2021-04:55:17] [V] [TRT] Tactic: 1769471 time 0.151668
[08/16/2021-04:55:17] [V] [TRT] Tactic: 1966079 time 0.284164
[08/16/2021-04:55:17] [V] [TRT] Tactic: 2031615 time 0.211024
[08/16/2021-04:55:17] [V] [TRT] Tactic: 2228223 time 0.132704
[08/16/2021-04:55:17] [V] [TRT] Tactic: 2424831 time 0.096876
[08/16/2021-04:55:17] [V] [TRT] Tactic: 2621439 time 0.088132
[08/16/2021-04:55:17] [V] [TRT] Tactic: 2752511 time 0.177248
[08/16/2021-04:55:17] [V] [TRT] Tactic: 2818047 time 0.171164
[08/16/2021-04:55:17] [V] [TRT] Tactic: 2883583 time 0.290608
[08/16/2021-04:55:17] [V] [TRT] Tactic: 3014655 time 0.114416
[08/16/2021-04:55:17] [V] [TRT] Tactic: 3145727 time 0.134996
[08/16/2021-04:55:17] [V] [TRT] Tactic: 3473407 time 0.152612
[08/16/2021-04:55:17] [V] [TRT] Tactic: 3604479 time 0.113568
[08/16/2021-04:55:17] [V] [TRT] Tactic: 3735551 time 0.12756
[08/16/2021-04:55:17] [V] [TRT] Tactic: 4390911 time 0.257756
[08/16/2021-04:55:17] [V] [TRT] Tactic: 5046271 time 0.120848
[08/16/2021-04:55:17] [V] [TRT] Tactic: 5963775 time 0.22284
[08/16/2021-04:55:18] [V] [TRT] Tactic: 6160383 time 0.149852
[08/16/2021-04:55:18] [V] [TRT] Tactic: 6488063 time 0.18618
[08/16/2021-04:55:18] [V] [TRT] Tactic: 6881279 time 0.196404
[08/16/2021-04:55:18] [V] [TRT] Tactic: 7274495 time 0.118252
[08/16/2021-04:55:18] [V] [TRT] Tactic: 7864319 time 0.167736
[08/16/2021-04:55:18] [V] [TRT] Tactic: 7995391 time 0.151104
[08/16/2021-04:55:18] [V] [TRT] Tactic: 8585215 time 0.182776
[08/16/2021-04:55:18] [V] [TRT] Tactic: 8847359 time 0.225088
[08/16/2021-04:55:18] [V] [TRT] Tactic: 8978431 time 0.22598
[08/16/2021-04:55:18] [V] [TRT] Tactic: 9043967 time 0.192516
[08/16/2021-04:55:18] [V] [TRT] Tactic: 9175039 time 0.113204
[08/16/2021-04:55:18] [V] [TRT] Tactic: 9502719 time 0.255724
[08/16/2021-04:55:18] [V] [TRT] Tactic: 9830399 time 0.155344
[08/16/2021-04:55:18] [V] [TRT] Tactic: 9961471 time 0.124248
[08/16/2021-04:55:18] [V] [TRT] Tactic: 10027007 time 0.143164
[08/16/2021-04:55:18] [V] [TRT] Tactic: 10092543 time 0.258276
[08/16/2021-04:55:18] [V] [TRT] Tactic: 10289151 time 0.28354
[08/16/2021-04:55:18] [V] [TRT] Tactic: 10485759 time 0.140336
[08/16/2021-04:55:18] [V] [TRT] Tactic: 10682367 time 0.08712
[08/16/2021-04:55:18] [V] [TRT] Tactic: 10813439 time 0.089932
[08/16/2021-04:55:18] [V] [TRT] Fastest Tactic: 10682367 Time: 0.08712
[08/16/2021-04:55:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (CaskConvolution)
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:18] [V] [TRT] Tactic: 1145226902788474763 time 0.231132
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:18] [V] [TRT] Tactic: 2418518597804310654 time 0.222568
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:18] [V] [TRT] Tactic: 8292881859266835088 time 0.27404
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:18] [V] [TRT] Tactic: 8401509141903434922 time 0.192252
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:18] [V] [TRT] Tactic: -8654297089785671176 time 0.285652
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:18] [V] [TRT] Tactic: -7448936905981214224 time 0.29176
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:18] [V] [TRT] Tactic: -3689982367035295496 time 0.288708
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:18] [V] [TRT] Tactic: -2027588946874785071 time 0.221904
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:18] [V] [TRT] Tactic: -245090590808296743 time 0.297964
[08/16/2021-04:55:18] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 0.192252
[08/16/2021-04:55:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (CudaConvolution)
[08/16/2021-04:55:18] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10682367
[08/16/2021-04:55:18] [V] [TRT] 
[08/16/2021-04:55:18] [V] [TRT] *************** Autotuning format combination: Half(64,512,1:8,4096) -> Float(1,8,64,16384) ***************
[08/16/2021-04:55:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (CaskConvolution)
[08/16/2021-04:55:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (CudaConvolution)
[08/16/2021-04:55:18] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:18] [V] [TRT] *************** Autotuning format combination: Half(64,512,1:8,4096) -> Half(32,256,1:8,2048) ***************
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (CaskConvolution)
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] Tactic: 3754069740140581927 time 0.117944
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] Tactic: 5925270497649423688 time 0.153708
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] Tactic: 6680916730816870145 time 0.093216
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] Tactic: 7158029511300006471 time 0.106576
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] Tactic: 7859952145590271433 time 0.093176
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] Tactic: 8283847742354150423 time 0.119912
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] Tactic: -4534876761957424274 time 0.1544
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] Tactic: -3237051169894153788 time 0.104384
[08/16/2021-04:55:18] [V] [TRT] Fastest Tactic: 7859952145590271433 Time: 0.093176
[08/16/2021-04:55:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (CudaConvolution)
[08/16/2021-04:55:18] [V] [TRT] Tactic: 0 time 0.388848
[08/16/2021-04:55:18] [V] [TRT] Tactic: 1 time 0.802468
[08/16/2021-04:55:18] [V] [TRT] Tactic: 2 time 0.310308
[08/16/2021-04:55:18] [V] [TRT] Tactic: 6 time 0.56216
[08/16/2021-04:55:18] [V] [TRT] Fastest Tactic: 2 Time: 0.310308
[08/16/2021-04:55:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7859952145590271433
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] 
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:18] [V] [TRT] *************** Autotuning format combination: Float(1,8,64,32768) -> Float(1,8,64,16384) ***************
[08/16/2021-04:55:18] [V] [TRT] *************** Autotuning format combination: Half(1,8,64,32768) -> Half(1,8,64,16384) ***************
[08/16/2021-04:55:18] [V] [TRT] *************** Autotuning format combination: Half(1,8,64:2,16384) -> Half(1,8,64:2,8192) ***************
[08/16/2021-04:55:18] [V] [TRT] *************** Autotuning format combination: Half(64,512,1:8,4096) -> Float(1,8,64,16384) ***************
[08/16/2021-04:55:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_4/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_4/Relu6 (CaskConvolution)
[08/16/2021-04:55:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_4/Relu6 (CudaConvolution)
[08/16/2021-04:55:18] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_4/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:18] [V] [TRT] *************** Autotuning format combination: Half(64,512,1:8,4096) -> Half(32,256,1:8,2048) ***************
[08/16/2021-04:55:18] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,65536) -> Float(1,16,256,65536) ***************
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:55:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:55:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:18] [V] [TRT] Tactic: 524287 time 0.559564
[08/16/2021-04:55:18] [V] [TRT] Tactic: 720895 time 0.555416
[08/16/2021-04:55:18] [V] [TRT] Tactic: 983039 time 0.529088
[08/16/2021-04:55:19] [V] [TRT] Tactic: 1048575 time 0.63728
[08/16/2021-04:55:19] [V] [TRT] Tactic: 1703935 time 0.544048
[08/16/2021-04:55:19] [V] [TRT] Tactic: 1769471 time 0.761728
[08/16/2021-04:55:19] [V] [TRT] Tactic: 1966079 time 0.651828
[08/16/2021-04:55:19] [V] [TRT] Tactic: 2031615 time 0.724412
[08/16/2021-04:55:19] [V] [TRT] Tactic: 2228223 time 0.465728
[08/16/2021-04:55:19] [V] [TRT] Tactic: 2424831 time 0.472224
[08/16/2021-04:55:19] [V] [TRT] Tactic: 2621439 time 0.579216
[08/16/2021-04:55:19] [V] [TRT] Tactic: 2752511 time 0.6426
[08/16/2021-04:55:19] [V] [TRT] Tactic: 2818047 time 0.670848
[08/16/2021-04:55:19] [V] [TRT] Tactic: 2883583 time 0.7752
[08/16/2021-04:55:19] [V] [TRT] Tactic: 3014655 time 0.531764
[08/16/2021-04:55:19] [V] [TRT] Tactic: 3145727 time 0.63374
[08/16/2021-04:55:19] [V] [TRT] Tactic: 3473407 time 0.56054
[08/16/2021-04:55:19] [V] [TRT] Tactic: 3604479 time 0.5293
[08/16/2021-04:55:19] [V] [TRT] Tactic: 3735551 time 0.696896
[08/16/2021-04:55:19] [V] [TRT] Tactic: 4390911 time 0.69036
[08/16/2021-04:55:19] [V] [TRT] Tactic: 5046271 time 0.631148
[08/16/2021-04:55:19] [V] [TRT] Tactic: 5963775 time 0.615484
[08/16/2021-04:55:19] [V] [TRT] Tactic: 6160383 time 0.553872
[08/16/2021-04:55:20] [V] [TRT] Tactic: 6488063 time 0.806592
[08/16/2021-04:55:20] [V] [TRT] Tactic: 6881279 time 0.617816
[08/16/2021-04:55:20] [V] [TRT] Tactic: 7274495 time 0.679356
[08/16/2021-04:55:20] [V] [TRT] Tactic: 7864319 time 0.628932
[08/16/2021-04:55:20] [V] [TRT] Tactic: 7995391 time 0.457972
[08/16/2021-04:55:20] [V] [TRT] Tactic: 8585215 time 0.674904
[08/16/2021-04:55:20] [V] [TRT] Tactic: 8847359 time 0.871328
[08/16/2021-04:55:20] [V] [TRT] Tactic: 8978431 time 0.612864
[08/16/2021-04:55:20] [V] [TRT] Tactic: 9043967 time 0.7002
[08/16/2021-04:55:20] [V] [TRT] Tactic: 9175039 time 0.52928
[08/16/2021-04:55:20] [V] [TRT] Tactic: 9502719 time 0.695236
[08/16/2021-04:55:20] [V] [TRT] Tactic: 9830399 time 0.54098
[08/16/2021-04:55:20] [V] [TRT] Tactic: 9961471 time 0.620368
[08/16/2021-04:55:20] [V] [TRT] Tactic: 10027007 time 0.6889
[08/16/2021-04:55:20] [V] [TRT] Tactic: 10092543 time 0.690892
[08/16/2021-04:55:20] [V] [TRT] Tactic: 10289151 time 0.652252
[08/16/2021-04:55:20] [V] [TRT] Tactic: 10485759 time 0.680992
[08/16/2021-04:55:20] [V] [TRT] Tactic: 10682367 time 0.55206
[08/16/2021-04:55:20] [V] [TRT] Tactic: 10813439 time 0.463308
[08/16/2021-04:55:20] [V] [TRT] Fastest Tactic: 7995391 Time: 0.457972
[08/16/2021-04:55:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (CaskConvolution)
[08/16/2021-04:55:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:55:20] [V] [TRT] Tactic: 1825138533642645384 time 0.578884
[08/16/2021-04:55:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:55:20] [V] [TRT] Tactic: 2842488832350522458 time 0.586164
[08/16/2021-04:55:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:55:20] [V] [TRT] Tactic: 3915320020053085238 time 0.555488
[08/16/2021-04:55:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:55:20] [V] [TRT] Tactic: 6448355332020552203 time 0.578328
[08/16/2021-04:55:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:55:21] [V] [TRT] Tactic: 6808617066150061604 time 0.577844
[08/16/2021-04:55:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:55:21] [V] [TRT] Tactic: -8060443123034038864 time 0.61108
[08/16/2021-04:55:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:55:21] [V] [TRT] Tactic: -4420849921117327522 time 0.555908
[08/16/2021-04:55:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:55:21] [V] [TRT] Tactic: -3946921629105938337 time 0.719636
[08/16/2021-04:55:21] [V] [TRT] Fastest Tactic: 3915320020053085238 Time: 0.555488
[08/16/2021-04:55:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (CudaConvolution)
[08/16/2021-04:55:21] [V] [TRT] Tactic: 0 time 0.680448
[08/16/2021-04:55:21] [V] [TRT] Tactic: 2 time 0.67194
[08/16/2021-04:55:21] [V] [TRT] Tactic: 5 skipped. Scratch requested: 287440896, available: 16777216
[08/16/2021-04:55:21] [V] [TRT] Tactic: 6 time 0.410348
[08/16/2021-04:55:21] [V] [TRT] Tactic: 57 time 1.10076
[08/16/2021-04:55:21] [V] [TRT] Fastest Tactic: 6 Time: 0.410348
[08/16/2021-04:55:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6
[08/16/2021-04:55:21] [V] [TRT] 
[08/16/2021-04:55:21] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,65536) -> Half(1,16,256,65536) ***************
[08/16/2021-04:55:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (CaskConvolution)
[08/16/2021-04:55:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (CudaConvolution)
[08/16/2021-04:55:21] [V] [TRT] Tactic: 0 time 0.834536
[08/16/2021-04:55:21] [V] [TRT] Tactic: 1 time 1.2395
[08/16/2021-04:55:21] [V] [TRT] Tactic: 2 time 0.752328
[08/16/2021-04:55:21] [V] [TRT] Tactic: 4 skipped. Scratch requested: 575012864, available: 16777216
[08/16/2021-04:55:21] [V] [TRT] Tactic: 5 skipped. Scratch requested: 287440896, available: 16777216
[08/16/2021-04:55:21] [V] [TRT] Tactic: 6 time 0.64048
[08/16/2021-04:55:21] [V] [TRT] Fastest Tactic: 6 Time: 0.64048
[08/16/2021-04:55:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6
[08/16/2021-04:55:21] [V] [TRT] 
[08/16/2021-04:55:21] [V] [TRT] *************** Autotuning format combination: Half(1,16,256:2,32768) -> Half(1,16,256:2,32768) ***************
[08/16/2021-04:55:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:21] [V] [TRT] Tactic: 524287 time 0.284604
[08/16/2021-04:55:21] [V] [TRT] Tactic: 720895 time 0.356592
[08/16/2021-04:55:21] [V] [TRT] Tactic: 983039 time 0.286096
[08/16/2021-04:55:21] [V] [TRT] Tactic: 1048575 time 0.316176
[08/16/2021-04:55:21] [V] [TRT] Tactic: 1703935 time 0.275748
[08/16/2021-04:55:21] [V] [TRT] Tactic: 1769471 time 0.395148
[08/16/2021-04:55:21] [V] [TRT] Tactic: 1966079 time 0.336324
[08/16/2021-04:55:21] [V] [TRT] Tactic: 2031615 time 0.36386
[08/16/2021-04:55:21] [V] [TRT] Tactic: 2228223 time 0.237552
[08/16/2021-04:55:21] [V] [TRT] Tactic: 2424831 time 0.245628
[08/16/2021-04:55:21] [V] [TRT] Tactic: 2621439 time 0.290372
[08/16/2021-04:55:21] [V] [TRT] Tactic: 2752511 time 0.394708
[08/16/2021-04:55:21] [V] [TRT] Tactic: 2818047 time 0.340988
[08/16/2021-04:55:21] [V] [TRT] Tactic: 2883583 time 0.391452
[08/16/2021-04:55:21] [V] [TRT] Tactic: 3014655 time 0.28064
[08/16/2021-04:55:21] [V] [TRT] Tactic: 3145727 time 0.338636
[08/16/2021-04:55:21] [V] [TRT] Tactic: 3473407 time 0.282396
[08/16/2021-04:55:21] [V] [TRT] Tactic: 3604479 time 0.278188
[08/16/2021-04:55:21] [V] [TRT] Tactic: 3735551 time 0.323964
[08/16/2021-04:55:21] [V] [TRT] Tactic: 4390911 time 0.353692
[08/16/2021-04:55:21] [V] [TRT] Tactic: 5046271 time 0.31284
[08/16/2021-04:55:21] [V] [TRT] Tactic: 5963775 time 0.310984
[08/16/2021-04:55:21] [V] [TRT] Tactic: 6160383 time 0.27796
[08/16/2021-04:55:22] [V] [TRT] Tactic: 6488063 time 0.39458
[08/16/2021-04:55:22] [V] [TRT] Tactic: 6881279 time 0.317956
[08/16/2021-04:55:22] [V] [TRT] Tactic: 7274495 time 0.342916
[08/16/2021-04:55:22] [V] [TRT] Tactic: 7864319 time 0.336164
[08/16/2021-04:55:22] [V] [TRT] Tactic: 7995391 time 0.234248
[08/16/2021-04:55:22] [V] [TRT] Tactic: 8585215 time 0.343016
[08/16/2021-04:55:22] [V] [TRT] Tactic: 8847359 time 0.463928
[08/16/2021-04:55:22] [V] [TRT] Tactic: 8978431 time 0.309036
[08/16/2021-04:55:22] [V] [TRT] Tactic: 9043967 time 0.361576
[08/16/2021-04:55:22] [V] [TRT] Tactic: 9175039 time 0.27524
[08/16/2021-04:55:22] [V] [TRT] Tactic: 9502719 time 0.352924
[08/16/2021-04:55:22] [V] [TRT] Tactic: 9830399 time 0.273668
[08/16/2021-04:55:22] [V] [TRT] Tactic: 9961471 time 0.323036
[08/16/2021-04:55:22] [V] [TRT] Tactic: 10027007 time 0.369448
[08/16/2021-04:55:22] [V] [TRT] Tactic: 10092543 time 0.353512
[08/16/2021-04:55:22] [V] [TRT] Tactic: 10289151 time 0.336512
[08/16/2021-04:55:22] [V] [TRT] Tactic: 10485759 time 0.346684
[08/16/2021-04:55:22] [V] [TRT] Tactic: 10682367 time 0.289456
[08/16/2021-04:55:22] [V] [TRT] Tactic: 10813439 time 0.241476
[08/16/2021-04:55:22] [V] [TRT] Fastest Tactic: 7995391 Time: 0.234248
[08/16/2021-04:55:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (CaskConvolution)
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:22] [V] [TRT] Tactic: 1145226902788474763 time 0.321588
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:22] [V] [TRT] Tactic: 2418518597804310654 time 0.319948
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:22] [V] [TRT] Tactic: 8292881859266835088 time 0.345532
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:22] [V] [TRT] Tactic: 8401509141903434922 time 0.298408
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:22] [V] [TRT] Tactic: -8654297089785671176 time 0.28652
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:22] [V] [TRT] Tactic: -7448936905981214224 time 0.362608
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:22] [V] [TRT] Tactic: -3689982367035295496 time 0.294912
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:22] [V] [TRT] Tactic: -2027588946874785071 time 0.311168
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:22] [V] [TRT] Tactic: -245090590808296743 time 0.299596
[08/16/2021-04:55:22] [V] [TRT] Fastest Tactic: -8654297089785671176 Time: 0.28652
[08/16/2021-04:55:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (CudaConvolution)
[08/16/2021-04:55:22] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7995391
[08/16/2021-04:55:22] [V] [TRT] 
[08/16/2021-04:55:22] [V] [TRT] *************** Autotuning format combination: Half(32,512,1:8,8192) -> Float(1,16,256,65536) ***************
[08/16/2021-04:55:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (CaskConvolution)
[08/16/2021-04:55:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (CudaConvolution)
[08/16/2021-04:55:22] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:22] [V] [TRT] *************** Autotuning format combination: Half(32,512,1:8,8192) -> Half(32,512,1:8,8192) ***************
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (CaskConvolution)
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:22] [V] [TRT] Tactic: 3754069740140581927 time 0.125668
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:22] [V] [TRT] Tactic: 5925270497649423688 time 0.162868
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:22] [V] [TRT] Tactic: 6680916730816870145 time 0.09784
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:22] [V] [TRT] Tactic: 7158029511300006471 time 0.121852
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:22] [V] [TRT] Tactic: 7859952145590271433 time 0.09884
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:22] [V] [TRT] Tactic: 8283847742354150423 time 0.12884
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:22] [V] [TRT] Tactic: -4534876761957424274 time 0.16316
[08/16/2021-04:55:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:22] [V] [TRT] Tactic: -3237051169894153788 time 0.11952
[08/16/2021-04:55:22] [V] [TRT] Fastest Tactic: 6680916730816870145 Time: 0.09784
[08/16/2021-04:55:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (CudaConvolution)
[08/16/2021-04:55:23] [V] [TRT] Tactic: 0 time 22.6315
[08/16/2021-04:55:23] [V] [TRT] Tactic: 1 time 1.07959
[08/16/2021-04:55:23] [V] [TRT] Tactic: 2 time 0.81214
[08/16/2021-04:55:23] [V] [TRT] Tactic: 6 time 0.558708
[08/16/2021-04:55:23] [V] [TRT] Fastest Tactic: 6 Time: 0.558708
[08/16/2021-04:55:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6680916730816870145
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:23] [V] [TRT] 
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:23] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,65536) -> Float(1,16,256,65536) ***************
[08/16/2021-04:55:23] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,65536) -> Half(1,16,256,65536) ***************
[08/16/2021-04:55:23] [V] [TRT] *************** Autotuning format combination: Half(1,16,256:2,32768) -> Half(1,16,256:2,32768) ***************
[08/16/2021-04:55:23] [V] [TRT] *************** Autotuning format combination: Half(32,512,1:8,8192) -> Float(1,16,256,65536) ***************
[08/16/2021-04:55:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_3/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_3/Relu6 (CaskConvolution)
[08/16/2021-04:55:23] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_3/Relu6 (CudaConvolution)
[08/16/2021-04:55:23] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_3/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:23] [V] [TRT] *************** Autotuning format combination: Half(32,512,1:8,8192) -> Half(32,512,1:8,8192) ***************
[08/16/2021-04:55:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:23] [V] [TRT] Tactic: 1002 time 0.240316
[08/16/2021-04:55:23] [V] [TRT] Tactic: 0 time 0.150788
[08/16/2021-04:55:23] [V] [TRT] Fastest Tactic: 0 Time: 0.150788
[08/16/2021-04:55:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:23] [V] [TRT] Tactic: 1002 time 0.392624
[08/16/2021-04:55:23] [V] [TRT] Tactic: 0 time 0.175984
[08/16/2021-04:55:23] [V] [TRT] Fastest Tactic: 0 Time: 0.175984
[08/16/2021-04:55:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:23] [V] [TRT] Tactic: 1002 time 0.29778
[08/16/2021-04:55:23] [V] [TRT] Tactic: 0 time 0.267724
[08/16/2021-04:55:23] [V] [TRT] Fastest Tactic: 0 Time: 0.267724
[08/16/2021-04:55:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:23] [V] [TRT] Tactic: 1002 time 0.26746
[08/16/2021-04:55:23] [V] [TRT] Tactic: 0 time 0.214628
[08/16/2021-04:55:23] [V] [TRT] Fastest Tactic: 0 Time: 0.214628
[08/16/2021-04:55:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:23] [V] [TRT] Tactic: 1002 time 0.391268
[08/16/2021-04:55:23] [V] [TRT] Tactic: 0 time 0.114444
[08/16/2021-04:55:23] [V] [TRT] Fastest Tactic: 0 Time: 0.114444
[08/16/2021-04:55:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:23] [V] [TRT] Tactic: 1002 time 0.29912
[08/16/2021-04:55:23] [V] [TRT] Tactic: 0 time 0.106216
[08/16/2021-04:55:23] [V] [TRT] Fastest Tactic: 0 Time: 0.106216
[08/16/2021-04:55:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:23] [V] [TRT] Tactic: 1002 time 0.494328
[08/16/2021-04:55:23] [V] [TRT] Tactic: 0 time 0.157036
[08/16/2021-04:55:23] [V] [TRT] Fastest Tactic: 0 Time: 0.157036
[08/16/2021-04:55:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:23] [V] [TRT] Tactic: 1002 time 0.487844
[08/16/2021-04:55:23] [V] [TRT] Tactic: 0 time 0.161824
[08/16/2021-04:55:23] [V] [TRT] Fastest Tactic: 0 Time: 0.161824
[08/16/2021-04:55:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:23] [V] [TRT] Tactic: 1002 time 0.296988
[08/16/2021-04:55:23] [V] [TRT] Tactic: 0 time 0.105596
[08/16/2021-04:55:23] [V] [TRT] Fastest Tactic: 0 Time: 0.105596
[08/16/2021-04:55:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:23] [V] [TRT] Tactic: 1002 time 0.305936
[08/16/2021-04:55:23] [V] [TRT] Tactic: 0 time 0.141468
[08/16/2021-04:55:23] [V] [TRT] Fastest Tactic: 0 Time: 0.141468
[08/16/2021-04:55:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:23] [V] [TRT] Tactic: 1002 time 0.29804
[08/16/2021-04:55:23] [V] [TRT] Tactic: 0 time 0.09504
[08/16/2021-04:55:23] [V] [TRT] Fastest Tactic: 0 Time: 0.09504
[08/16/2021-04:55:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:23] [V] [TRT] Tactic: 1002 time 0.423616
[08/16/2021-04:55:23] [V] [TRT] Tactic: 0 time 0.0942
[08/16/2021-04:55:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0942
[08/16/2021-04:55:23] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,2097152) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:55:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (CaskConvolution)
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:55:23] [V] [TRT] Tactic: 1825138533642645384 time 6.13287
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:55:23] [V] [TRT] Tactic: 2842488832350522458 time 6.15572
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:55:23] [V] [TRT] Tactic: 3915320020053085238 time 6.04354
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:55:23] [V] [TRT] Tactic: 6448355332020552203 time 6.11038
[08/16/2021-04:55:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:55:24] [V] [TRT] Tactic: 6808617066150061604 time 6.11603
[08/16/2021-04:55:24] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:55:24] [V] [TRT] Tactic: -8060443123034038864 time 6.17328
[08/16/2021-04:55:24] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:55:24] [V] [TRT] Tactic: -4420849921117327522 time 6.63724
[08/16/2021-04:55:24] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:55:24] [V] [TRT] Tactic: -3946921629105938337 time 6.58371
[08/16/2021-04:55:24] [V] [TRT] Fastest Tactic: 3915320020053085238 Time: 6.04354
[08/16/2021-04:55:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (CudaConvolution)
[08/16/2021-04:55:24] [V] [TRT] Tactic: 0 time 9.40355
[08/16/2021-04:55:24] [V] [TRT] Tactic: 2 skipped. Scratch requested: 37748736, available: 16777216
[08/16/2021-04:55:24] [V] [TRT] Tactic: 5 skipped. Scratch requested: 289669120, available: 16777216
[08/16/2021-04:55:24] [V] [TRT] Tactic: 6 time 3.93838
[08/16/2021-04:55:24] [V] [TRT] Tactic: 57 time 8.62503
[08/16/2021-04:55:24] [V] [TRT] Fastest Tactic: 6 Time: 3.93838
[08/16/2021-04:55:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:24] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6
[08/16/2021-04:55:24] [V] [TRT] 
[08/16/2021-04:55:24] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,2097152) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:55:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:24] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (CaskConvolution)
[08/16/2021-04:55:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (CudaConvolution)
[08/16/2021-04:55:24] [V] [TRT] Tactic: 0 time 9.6307
[08/16/2021-04:55:25] [V] [TRT] Tactic: 1 time 6.81894
[08/16/2021-04:55:25] [V] [TRT] Tactic: 2 skipped. Scratch requested: 18874368, available: 16777216
[08/16/2021-04:55:25] [V] [TRT] Tactic: 4 skipped. Scratch requested: 8760590336, available: 16777216
[08/16/2021-04:55:25] [V] [TRT] Tactic: 5 skipped. Scratch requested: 289669120, available: 16777216
[08/16/2021-04:55:25] [V] [TRT] Tactic: 6 skipped. Scratch requested: 17303040, available: 16777216
[08/16/2021-04:55:25] [V] [TRT] Fastest Tactic: 1 Time: 6.81894
[08/16/2021-04:55:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:55:25] [V] [TRT] 
[08/16/2021-04:55:25] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,1048576) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:25] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (CaskConvolution)
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:25] [V] [TRT] Tactic: 1145226902788474763 time 3.1332
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:25] [V] [TRT] Tactic: 2418518597804310654 time 3.14318
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:25] [V] [TRT] Tactic: 8292881859266835088 time 3.35604
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:25] [V] [TRT] Tactic: 8401509141903434922 time 3.0957
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:25] [V] [TRT] Tactic: -8654297089785671176 time 3.09216
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:25] [V] [TRT] Tactic: -7448936905981214224 time 3.54264
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:25] [V] [TRT] Tactic: -3689982367035295496 time 3.10196
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:25] [V] [TRT] Tactic: -2027588946874785071 time 3.30943
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:25] [V] [TRT] Tactic: -245090590808296743 time 3.15498
[08/16/2021-04:55:25] [V] [TRT] Fastest Tactic: -8654297089785671176 Time: 3.09216
[08/16/2021-04:55:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (CudaConvolution)
[08/16/2021-04:55:25] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8654297089785671176
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:25] [V] [TRT] 
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:25] [V] [TRT] *************** Autotuning format combination: Half(64,4096,1:8,262144) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:55:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:25] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (CaskConvolution)
[08/16/2021-04:55:25] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (CudaConvolution)
[08/16/2021-04:55:25] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:25] [V] [TRT] *************** Autotuning format combination: Half(64,4096,1:8,262144) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:25] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (CaskConvolution)
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:25] [V] [TRT] Tactic: 3754069740140581927 time 1.00708
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:25] [V] [TRT] Tactic: 5925270497649423688 time 0.972996
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:25] [V] [TRT] Tactic: 6680916730816870145 time 1.26274
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:25] [V] [TRT] Tactic: 7158029511300006471 time 1.19084
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:25] [V] [TRT] Tactic: 7859952145590271433 time 1.14711
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:25] [V] [TRT] Tactic: 8283847742354150423 time 1.12016
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:25] [V] [TRT] Tactic: -4534876761957424274 time 1.09984
[08/16/2021-04:55:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:25] [V] [TRT] Tactic: -3237051169894153788 time 1.11731
[08/16/2021-04:55:25] [V] [TRT] Fastest Tactic: 5925270497649423688 Time: 0.972996
[08/16/2021-04:55:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (CudaConvolution)
[08/16/2021-04:55:26] [V] [TRT] Tactic: 0 time 20.7652
[08/16/2021-04:55:26] [V] [TRT] Tactic: 1 time 14.4384
[08/16/2021-04:55:26] [V] [TRT] Tactic: 2 skipped. Scratch requested: 20972032, available: 16777216
[08/16/2021-04:55:26] [V] [TRT] Tactic: 6 skipped. Scratch requested: 17303040, available: 16777216
[08/16/2021-04:55:26] [V] [TRT] Fastest Tactic: 1 Time: 14.4384
[08/16/2021-04:55:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5925270497649423688
[08/16/2021-04:55:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:26] [V] [TRT] 
[08/16/2021-04:55:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:26] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,2097152) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:55:26] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,2097152) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:55:26] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,1048576) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:55:26] [V] [TRT] *************** Autotuning format combination: Half(64,4096,1:8,262144) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:55:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_1/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_1/Relu6 (CaskConvolution)
[08/16/2021-04:55:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_1/Relu6 (CudaConvolution)
[08/16/2021-04:55:26] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_1/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:26] [V] [TRT] *************** Autotuning format combination: Half(64,4096,1:8,262144) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:55:26] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,4194304) -> Float(1,128,16384,8388608) ***************
[08/16/2021-04:55:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:55:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:55:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:55:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:55:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:55:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:55:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:55:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:55:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (CaskConvolution)
[08/16/2021-04:55:26] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:55:27] [V] [TRT] Tactic: 1825138533642645384 time 46.7523
[08/16/2021-04:55:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:55:28] [V] [TRT] Tactic: 2842488832350522458 time 47.0505
[08/16/2021-04:55:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:55:28] [V] [TRT] Tactic: 3915320020053085238 time 46.6378
[08/16/2021-04:55:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:55:29] [V] [TRT] Tactic: 6448355332020552203 time 48.0537
[08/16/2021-04:55:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:55:30] [V] [TRT] Tactic: 6808617066150061604 time 47.4448
[08/16/2021-04:55:30] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:55:31] [V] [TRT] Tactic: -8060443123034038864 time 48.311
[08/16/2021-04:55:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:55:32] [V] [TRT] Tactic: -4420849921117327522 time 52.025
[08/16/2021-04:55:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:55:32] [V] [TRT] Tactic: -3946921629105938337 time 50.856
[08/16/2021-04:55:32] [V] [TRT] Fastest Tactic: 3915320020053085238 Time: 46.6378
[08/16/2021-04:55:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (CudaConvolution)
[08/16/2021-04:55:33] [V] [TRT] Tactic: 0 time 61.9598
[08/16/2021-04:55:33] [V] [TRT] Tactic: 2 skipped. Scratch requested: 150994944, available: 16777216
[08/16/2021-04:55:33] [V] [TRT] Tactic: 5 skipped. Scratch requested: 577110016, available: 16777216
[08/16/2021-04:55:34] [V] [TRT] Tactic: 6 time 33.3321
[08/16/2021-04:55:34] [V] [TRT] Tactic: 57 skipped. Scratch requested: 59867648, available: 16777216
[08/16/2021-04:55:34] [V] [TRT] Fastest Tactic: 6 Time: 33.3321
[08/16/2021-04:55:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6
[08/16/2021-04:55:34] [V] [TRT] 
[08/16/2021-04:55:34] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,4194304) -> Half(1,128,16384,8388608) ***************
[08/16/2021-04:55:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (CaskConvolution)
[08/16/2021-04:55:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (CudaConvolution)
[08/16/2021-04:55:35] [V] [TRT] Tactic: 0 time 62.5028
[08/16/2021-04:55:36] [V] [TRT] Tactic: 1 time 68.6776
[08/16/2021-04:55:36] [V] [TRT] Tactic: 2 skipped. Scratch requested: 75497472, available: 16777216
[08/16/2021-04:55:36] [V] [TRT] Tactic: 4 skipped. Scratch requested: 69396332544, available: 16777216
[08/16/2021-04:55:36] [V] [TRT] Tactic: 5 skipped. Scratch requested: 577110016, available: 16777216
[08/16/2021-04:55:36] [V] [TRT] Tactic: 6 skipped. Scratch requested: 68160000, available: 16777216
[08/16/2021-04:55:36] [V] [TRT] Fastest Tactic: 0 Time: 62.5028
[08/16/2021-04:55:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0
[08/16/2021-04:55:36] [V] [TRT] 
[08/16/2021-04:55:36] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,2097152) -> Half(1,128,16384:2,4194304) ***************
[08/16/2021-04:55:36] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:36] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:36] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:36] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:36] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:36] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:36] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:36] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:36] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (CaskConvolution)
[08/16/2021-04:55:36] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:37] [V] [TRT] Tactic: 1145226902788474763 time 24.1825
[08/16/2021-04:55:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:37] [V] [TRT] Tactic: 2418518597804310654 time 24.2831
[08/16/2021-04:55:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:37] [V] [TRT] Tactic: 8292881859266835088 time 25.9525
[08/16/2021-04:55:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:38] [V] [TRT] Tactic: 8401509141903434922 time 23.9573
[08/16/2021-04:55:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:38] [V] [TRT] Tactic: -8654297089785671176 time 24.1174
[08/16/2021-04:55:38] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:39] [V] [TRT] Tactic: -7448936905981214224 time 26.238
[08/16/2021-04:55:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:39] [V] [TRT] Tactic: -3689982367035295496 time 24.1946
[08/16/2021-04:55:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:39] [V] [TRT] Tactic: -2027588946874785071 time 25.1079
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:40] [V] [TRT] Tactic: -245090590808296743 time 24.5488
[08/16/2021-04:55:40] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 23.9573
[08/16/2021-04:55:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (CudaConvolution)
[08/16/2021-04:55:40] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8401509141903434922
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:40] [V] [TRT] 
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:40] [V] [TRT] *************** Autotuning format combination: Half(32,4096,1:8,524288) -> Float(1,128,16384,8388608) ***************
[08/16/2021-04:55:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (CaskConvolution)
[08/16/2021-04:55:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (CudaConvolution)
[08/16/2021-04:55:40] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:40] [V] [TRT] *************** Autotuning format combination: Half(32,4096,1:8,524288) -> Half(64,8192,1:8,1048576) ***************
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (CaskConvolution)
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:40] [V] [TRT] Tactic: 3754069740140581927 time 7.49782
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:40] [V] [TRT] Tactic: 5925270497649423688 time 7.06508
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:40] [V] [TRT] Tactic: 6680916730816870145 time 8.06492
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:40] [V] [TRT] Tactic: 7158029511300006471 time 7.69879
[08/16/2021-04:55:40] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:41] [V] [TRT] Tactic: 7859952145590271433 time 8.08337
[08/16/2021-04:55:41] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:41] [V] [TRT] Tactic: 8283847742354150423 time 7.42981
[08/16/2021-04:55:41] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:41] [V] [TRT] Tactic: -4534876761957424274 time 7.36229
[08/16/2021-04:55:41] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:41] [V] [TRT] Tactic: -3237051169894153788 time 7.60174
[08/16/2021-04:55:41] [V] [TRT] Fastest Tactic: 5925270497649423688 Time: 7.06508
[08/16/2021-04:55:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (CudaConvolution)
[08/16/2021-04:55:42] [V] [TRT] Tactic: 0 time 77.0906
[08/16/2021-04:55:42] [V] [TRT] Tactic: 1 skipped. Scratch requested: 25175552, available: 16777216
[08/16/2021-04:55:42] [V] [TRT] Tactic: 2 skipped. Scratch requested: 92275200, available: 16777216
[08/16/2021-04:55:42] [V] [TRT] Tactic: 6 skipped. Scratch requested: 68160000, available: 16777216
[08/16/2021-04:55:42] [V] [TRT] Fastest Tactic: 0 Time: 77.0906
[08/16/2021-04:55:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5925270497649423688
[08/16/2021-04:55:42] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:42] [V] [TRT] 
[08/16/2021-04:55:42] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:42] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:42] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:42] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:42] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:42] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:42] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:42] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:42] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:42] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:42] [V] [TRT] Tactic: 1002 time 0.998552
[08/16/2021-04:55:42] [V] [TRT] Tactic: 0 time 0.631532
[08/16/2021-04:55:42] [V] [TRT] Fastest Tactic: 0 Time: 0.631532
[08/16/2021-04:55:42] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:42] [V] [TRT] Tactic: 1002 time 1.81161
[08/16/2021-04:55:42] [V] [TRT] Tactic: 0 time 0.686116
[08/16/2021-04:55:42] [V] [TRT] Fastest Tactic: 0 Time: 0.686116
[08/16/2021-04:55:42] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:43] [V] [TRT] Tactic: 1002 time 1.10498
[08/16/2021-04:55:43] [V] [TRT] Tactic: 0 time 2.05392
[08/16/2021-04:55:43] [V] [TRT] Fastest Tactic: 1002 Time: 1.10498
[08/16/2021-04:55:43] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:43] [V] [TRT] Tactic: 1002 time 1.0711
[08/16/2021-04:55:43] [V] [TRT] Tactic: 0 time 0.836388
[08/16/2021-04:55:43] [V] [TRT] Fastest Tactic: 0 Time: 0.836388
[08/16/2021-04:55:43] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:43] [V] [TRT] Tactic: 1002 time 1.80006
[08/16/2021-04:55:43] [V] [TRT] Tactic: 0 time 0.438204
[08/16/2021-04:55:43] [V] [TRT] Fastest Tactic: 0 Time: 0.438204
[08/16/2021-04:55:43] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:43] [V] [TRT] Tactic: 1002 time 1.11258
[08/16/2021-04:55:43] [V] [TRT] Tactic: 0 time 0.400716
[08/16/2021-04:55:43] [V] [TRT] Fastest Tactic: 0 Time: 0.400716
[08/16/2021-04:55:43] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:43] [V] [TRT] Tactic: 1002 time 1.98865
[08/16/2021-04:55:43] [V] [TRT] Tactic: 0 time 0.551876
[08/16/2021-04:55:43] [V] [TRT] Fastest Tactic: 0 Time: 0.551876
[08/16/2021-04:55:43] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:43] [V] [TRT] Tactic: 1002 time 1.9737
[08/16/2021-04:55:43] [V] [TRT] Tactic: 0 time 0.622728
[08/16/2021-04:55:43] [V] [TRT] Fastest Tactic: 0 Time: 0.622728
[08/16/2021-04:55:43] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:43] [V] [TRT] Tactic: 1002 time 1.1031
[08/16/2021-04:55:43] [V] [TRT] Tactic: 0 time 0.41362
[08/16/2021-04:55:43] [V] [TRT] Fastest Tactic: 0 Time: 0.41362
[08/16/2021-04:55:43] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:43] [V] [TRT] Tactic: 1002 time 1.14676
[08/16/2021-04:55:43] [V] [TRT] Tactic: 0 time 0.55644
[08/16/2021-04:55:43] [V] [TRT] Fastest Tactic: 0 Time: 0.55644
[08/16/2021-04:55:43] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:43] [V] [TRT] Tactic: 1002 time 1.11233
[08/16/2021-04:55:43] [V] [TRT] Tactic: 0 time 0.362348
[08/16/2021-04:55:43] [V] [TRT] Fastest Tactic: 0 Time: 0.362348
[08/16/2021-04:55:43] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:55:43] [V] [TRT] Tactic: 1002 time 1.75244
[08/16/2021-04:55:43] [V] [TRT] Tactic: 0 time 0.369216
[08/16/2021-04:55:43] [V] [TRT] Fastest Tactic: 0 Time: 0.369216
[08/16/2021-04:55:43] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,8388608) -> Float(1,128,16384,4194304) ***************
[08/16/2021-04:55:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:55:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:55:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:55:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:55:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:55:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:55:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:55:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:55:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:43] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (CaskConvolution)
[08/16/2021-04:55:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:55:43] [V] [TRT] Tactic: 1825138533642645384 time 23.5189
[08/16/2021-04:55:43] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:55:44] [V] [TRT] Tactic: 2842488832350522458 time 23.4391
[08/16/2021-04:55:44] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:55:44] [V] [TRT] Tactic: 3915320020053085238 time 23.3304
[08/16/2021-04:55:44] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:55:45] [V] [TRT] Tactic: 6448355332020552203 time 23.8131
[08/16/2021-04:55:45] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:55:45] [V] [TRT] Tactic: 6808617066150061604 time 23.8452
[08/16/2021-04:55:45] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:55:45] [V] [TRT] Tactic: -8060443123034038864 time 24.0568
[08/16/2021-04:55:45] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:55:46] [V] [TRT] Tactic: -4420849921117327522 time 26.0211
[08/16/2021-04:55:46] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:55:46] [V] [TRT] Tactic: -3946921629105938337 time 25.3967
[08/16/2021-04:55:46] [V] [TRT] Fastest Tactic: 3915320020053085238 Time: 23.3304
[08/16/2021-04:55:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (CudaConvolution)
[08/16/2021-04:55:47] [V] [TRT] Tactic: 0 time 30.7612
[08/16/2021-04:55:47] [V] [TRT] Tactic: 2 skipped. Scratch requested: 150994944, available: 16777216
[08/16/2021-04:55:47] [V] [TRT] Tactic: 5 skipped. Scratch requested: 289669120, available: 16777216
[08/16/2021-04:55:47] [V] [TRT] Tactic: 6 time 16.1757
[08/16/2021-04:55:47] [V] [TRT] Tactic: 57 skipped. Scratch requested: 38371840, available: 16777216
[08/16/2021-04:55:47] [V] [TRT] Fastest Tactic: 6 Time: 16.1757
[08/16/2021-04:55:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:47] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6
[08/16/2021-04:55:47] [V] [TRT] 
[08/16/2021-04:55:47] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,8388608) -> Half(1,128,16384,4194304) ***************
[08/16/2021-04:55:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:47] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (CaskConvolution)
[08/16/2021-04:55:47] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (CudaConvolution)
[08/16/2021-04:55:47] [V] [TRT] Tactic: 0 time 31.0435
[08/16/2021-04:55:48] [V] [TRT] Tactic: 1 time 34.9947
[08/16/2021-04:55:48] [V] [TRT] Tactic: 2 skipped. Scratch requested: 75497472, available: 16777216
[08/16/2021-04:55:48] [V] [TRT] Tactic: 4 skipped. Scratch requested: 34765799424, available: 16777216
[08/16/2021-04:55:48] [V] [TRT] Tactic: 5 skipped. Scratch requested: 289669120, available: 16777216
[08/16/2021-04:55:48] [V] [TRT] Tactic: 6 skipped. Scratch requested: 42468864, available: 16777216
[08/16/2021-04:55:48] [V] [TRT] Fastest Tactic: 0 Time: 31.0435
[08/16/2021-04:55:48] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:48] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0
[08/16/2021-04:55:48] [V] [TRT] 
[08/16/2021-04:55:48] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,4194304) -> Half(1,128,16384:2,2097152) ***************
[08/16/2021-04:55:48] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:48] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:48] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:48] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:48] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:48] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:48] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:48] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:48] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:48] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:48] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:48] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (CaskConvolution)
[08/16/2021-04:55:48] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:48] [V] [TRT] Tactic: 1145226902788474763 time 12.1702
[08/16/2021-04:55:48] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:48] [V] [TRT] Tactic: 2418518597804310654 time 12.2838
[08/16/2021-04:55:49] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:49] [V] [TRT] Tactic: 8292881859266835088 time 13.1835
[08/16/2021-04:55:49] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:49] [V] [TRT] Tactic: 8401509141903434922 time 12.0815
[08/16/2021-04:55:49] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:49] [V] [TRT] Tactic: -8654297089785671176 time 12.0624
[08/16/2021-04:55:49] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:49] [V] [TRT] Tactic: -7448936905981214224 time 13.3737
[08/16/2021-04:55:49] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:50] [V] [TRT] Tactic: -3689982367035295496 time 12.1063
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:50] [V] [TRT] Tactic: -2027588946874785071 time 12.7481
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:50] [V] [TRT] Tactic: -245090590808296743 time 12.2796
[08/16/2021-04:55:50] [V] [TRT] Fastest Tactic: -8654297089785671176 Time: 12.0624
[08/16/2021-04:55:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (CudaConvolution)
[08/16/2021-04:55:50] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8654297089785671176
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:50] [V] [TRT] 
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:50] [V] [TRT] *************** Autotuning format combination: Half(64,8192,1:8,1048576) -> Float(1,128,16384,4194304) ***************
[08/16/2021-04:55:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:50] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (CaskConvolution)
[08/16/2021-04:55:50] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (CudaConvolution)
[08/16/2021-04:55:50] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:50] [V] [TRT] *************** Autotuning format combination: Half(64,8192,1:8,1048576) -> Half(32,4096,1:8,524288) ***************
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:50] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (CaskConvolution)
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:50] [V] [TRT] Tactic: 3754069740140581927 time 3.94939
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:50] [V] [TRT] Tactic: 5925270497649423688 time 3.64658
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:50] [V] [TRT] Tactic: 6680916730816870145 time 4.07974
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:50] [V] [TRT] Tactic: 7158029511300006471 time 3.89947
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:50] [V] [TRT] Tactic: 7859952145590271433 time 4.09532
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:50] [V] [TRT] Tactic: 8283847742354150423 time 3.75802
[08/16/2021-04:55:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:51] [V] [TRT] Tactic: -4534876761957424274 time 3.79138
[08/16/2021-04:55:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:51] [V] [TRT] Tactic: -3237051169894153788 time 3.8641
[08/16/2021-04:55:51] [V] [TRT] Fastest Tactic: 5925270497649423688 Time: 3.64658
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (CudaConvolution)
[08/16/2021-04:55:51] [V] [TRT] Tactic: 0 time 34.9111
[08/16/2021-04:55:51] [V] [TRT] Tactic: 1 skipped. Scratch requested: 16786944, available: 16777216
[08/16/2021-04:55:51] [V] [TRT] Tactic: 2 skipped. Scratch requested: 83886592, available: 16777216
[08/16/2021-04:55:51] [V] [TRT] Tactic: 6 skipped. Scratch requested: 42468864, available: 16777216
[08/16/2021-04:55:51] [V] [TRT] Fastest Tactic: 0 Time: 34.9111
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5925270497649423688
[08/16/2021-04:55:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:51] [V] [TRT] 
[08/16/2021-04:55:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,8388608) -> Float(1,128,16384,4194304) ***************
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,8388608) -> Half(1,128,16384,4194304) ***************
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,4194304) -> Half(1,128,16384:2,2097152) ***************
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Half(64,8192,1:8,1048576) -> Float(1,128,16384,4194304) ***************
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_0/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_0/Relu6 (CaskConvolution)
[08/16/2021-04:55:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_0/Relu6 (CudaConvolution)
[08/16/2021-04:55:51] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_0/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Half(64,8192,1:8,1048576) -> Half(32,4096,1:8,524288) ***************
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_1/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_1/Relu6 (CaskConvolution)
[08/16/2021-04:55:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_1/Relu6 (CudaConvolution)
[08/16/2021-04:55:51] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_1/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_1/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_1/Relu6 (CaskConvolution)
[08/16/2021-04:55:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_1/Relu6 (CudaConvolution)
[08/16/2021-04:55:51] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_1/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,65536) -> Float(1,16,256,65536) ***************
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,65536) -> Half(1,16,256,65536) ***************
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Half(1,16,256:2,32768) -> Half(1,16,256:2,32768) ***************
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Half(32,512,1:8,8192) -> Float(1,16,256,65536) ***************
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_3/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_3/Relu6 (CaskConvolution)
[08/16/2021-04:55:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_3/Relu6 (CudaConvolution)
[08/16/2021-04:55:51] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_3/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Half(32,512,1:8,8192) -> Half(32,512,1:8,8192) ***************
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,65536) -> Float(1,16,256,65536) ***************
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,65536) -> Half(1,16,256,65536) ***************
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Half(1,16,256:2,32768) -> Half(1,16,256:2,32768) ***************
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Half(32,512,1:8,8192) -> Float(1,16,256,65536) ***************
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_3/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_3/Relu6 (CaskConvolution)
[08/16/2021-04:55:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_3/Relu6 (CudaConvolution)
[08/16/2021-04:55:51] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_3/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Half(32,512,1:8,8192) -> Half(32,512,1:8,8192) ***************
[08/16/2021-04:55:51] [V] [TRT] *************** Autotuning format combination: Float(1,8,64,16384) -> Float(1,8,64,16384) ***************
[08/16/2021-04:55:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:55:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:55:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:55:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:55:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:55:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:55:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:55:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:55:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:51] [V] [TRT] Tactic: 524287 time 0.323508
[08/16/2021-04:55:51] [V] [TRT] Tactic: 720895 time 0.318272
[08/16/2021-04:55:51] [V] [TRT] Tactic: 983039 time 0.211948
[08/16/2021-04:55:52] [V] [TRT] Tactic: 1048575 time 0.219544
[08/16/2021-04:55:52] [V] [TRT] Tactic: 1703935 time 0.163008
[08/16/2021-04:55:52] [V] [TRT] Tactic: 1769471 time 0.28832
[08/16/2021-04:55:52] [V] [TRT] Tactic: 1966079 time 0.469364
[08/16/2021-04:55:52] [V] [TRT] Tactic: 2031615 time 0.412724
[08/16/2021-04:55:52] [V] [TRT] Tactic: 2228223 time 0.256996
[08/16/2021-04:55:52] [V] [TRT] Tactic: 2424831 time 0.185516
[08/16/2021-04:55:52] [V] [TRT] Tactic: 2621439 time 0.170628
[08/16/2021-04:55:52] [V] [TRT] Tactic: 2752511 time 0.349016
[08/16/2021-04:55:52] [V] [TRT] Tactic: 2818047 time 0.339296
[08/16/2021-04:55:52] [V] [TRT] Tactic: 2883583 time 0.569984
[08/16/2021-04:55:52] [V] [TRT] Tactic: 3014655 time 0.207956
[08/16/2021-04:55:52] [V] [TRT] Tactic: 3145727 time 0.252324
[08/16/2021-04:55:52] [V] [TRT] Tactic: 3473407 time 0.295252
[08/16/2021-04:55:52] [V] [TRT] Tactic: 3604479 time 0.205916
[08/16/2021-04:55:52] [V] [TRT] Tactic: 3735551 time 0.276736
[08/16/2021-04:55:52] [V] [TRT] Tactic: 4390911 time 0.500088
[08/16/2021-04:55:52] [V] [TRT] Tactic: 5046271 time 0.221608
[08/16/2021-04:55:52] [V] [TRT] Tactic: 5963775 time 0.440116
[08/16/2021-04:55:52] [V] [TRT] Tactic: 6160383 time 0.305608
[08/16/2021-04:55:52] [V] [TRT] Tactic: 6488063 time 0.362696
[08/16/2021-04:55:52] [V] [TRT] Tactic: 6881279 time 0.385728
[08/16/2021-04:55:52] [V] [TRT] Tactic: 7274495 time 0.229044
[08/16/2021-04:55:52] [V] [TRT] Tactic: 7864319 time 0.315128
[08/16/2021-04:55:52] [V] [TRT] Tactic: 7995391 time 0.318844
[08/16/2021-04:55:52] [V] [TRT] Tactic: 8585215 time 0.352592
[08/16/2021-04:55:52] [V] [TRT] Tactic: 8847359 time 0.427956
[08/16/2021-04:55:53] [V] [TRT] Tactic: 8978431 time 0.440576
[08/16/2021-04:55:53] [V] [TRT] Tactic: 9043967 time 0.369692
[08/16/2021-04:55:53] [V] [TRT] Tactic: 9175039 time 0.206536
[08/16/2021-04:55:53] [V] [TRT] Tactic: 9502719 time 0.49958
[08/16/2021-04:55:53] [V] [TRT] Tactic: 9830399 time 0.308528
[08/16/2021-04:55:53] [V] [TRT] Tactic: 9961471 time 0.230248
[08/16/2021-04:55:53] [V] [TRT] Tactic: 10027007 time 0.328228
[08/16/2021-04:55:53] [V] [TRT] Tactic: 10092543 time 0.499476
[08/16/2021-04:55:53] [V] [TRT] Tactic: 10289151 time 0.469344
[08/16/2021-04:55:53] [V] [TRT] Tactic: 10485759 time 0.2541
[08/16/2021-04:55:53] [V] [TRT] Tactic: 10682367 time 0.159436
[08/16/2021-04:55:53] [V] [TRT] Tactic: 10813439 time 0.17258
[08/16/2021-04:55:53] [V] [TRT] Fastest Tactic: 10682367 Time: 0.159436
[08/16/2021-04:55:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (CaskConvolution)
[08/16/2021-04:55:53] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:55:53] [V] [TRT] Tactic: 1825138533642645384 time 0.563568
[08/16/2021-04:55:53] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:55:53] [V] [TRT] Tactic: 2842488832350522458 time 0.435244
[08/16/2021-04:55:53] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:55:53] [V] [TRT] Tactic: 3915320020053085238 time 0.553668
[08/16/2021-04:55:53] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:55:53] [V] [TRT] Tactic: 6448355332020552203 time 0.573488
[08/16/2021-04:55:53] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:55:53] [V] [TRT] Tactic: 6808617066150061604 time 0.39022
[08/16/2021-04:55:53] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:55:53] [V] [TRT] Tactic: -8060443123034038864 time 0.441712
[08/16/2021-04:55:53] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:55:53] [V] [TRT] Tactic: -4420849921117327522 time 0.539744
[08/16/2021-04:55:53] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:55:53] [V] [TRT] Tactic: -3946921629105938337 time 0.664236
[08/16/2021-04:55:53] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.39022
[08/16/2021-04:55:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (CudaConvolution)
[08/16/2021-04:55:53] [V] [TRT] Tactic: 0 time 0.297828
[08/16/2021-04:55:53] [V] [TRT] Tactic: 2 time 0.344136
[08/16/2021-04:55:53] [V] [TRT] Tactic: 5 skipped. Scratch requested: 287440896, available: 16777216
[08/16/2021-04:55:53] [V] [TRT] Tactic: 6 time 0.328784
[08/16/2021-04:55:53] [V] [TRT] Tactic: 57 time 0.916564
[08/16/2021-04:55:53] [V] [TRT] Fastest Tactic: 0 Time: 0.297828
[08/16/2021-04:55:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10682367
[08/16/2021-04:55:53] [V] [TRT] 
[08/16/2021-04:55:53] [V] [TRT] *************** Autotuning format combination: Half(1,8,64,16384) -> Half(1,8,64,16384) ***************
[08/16/2021-04:55:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:53] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (CaskConvolution)
[08/16/2021-04:55:53] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (CudaConvolution)
[08/16/2021-04:55:53] [V] [TRT] Tactic: 0 time 0.359348
[08/16/2021-04:55:53] [V] [TRT] Tactic: 1 time 0.767536
[08/16/2021-04:55:53] [V] [TRT] Tactic: 2 time 0.303656
[08/16/2021-04:55:53] [V] [TRT] Tactic: 4 skipped. Scratch requested: 153944064, available: 16777216
[08/16/2021-04:55:53] [V] [TRT] Tactic: 5 skipped. Scratch requested: 287440896, available: 16777216
[08/16/2021-04:55:53] [V] [TRT] Tactic: 6 time 0.546448
[08/16/2021-04:55:53] [V] [TRT] Fastest Tactic: 2 Time: 0.303656
[08/16/2021-04:55:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2
[08/16/2021-04:55:53] [V] [TRT] 
[08/16/2021-04:55:53] [V] [TRT] *************** Autotuning format combination: Half(1,8,64:2,8192) -> Half(1,8,64:2,8192) ***************
[08/16/2021-04:55:53] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:53] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:53] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:53] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:53] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:53] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:53] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:53] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:53] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:53] [V] [TRT] Tactic: 524287 time 0.163168
[08/16/2021-04:55:53] [V] [TRT] Tactic: 720895 time 0.161456
[08/16/2021-04:55:53] [V] [TRT] Tactic: 983039 time 0.11018
[08/16/2021-04:55:53] [V] [TRT] Tactic: 1048575 time 0.11416
[08/16/2021-04:55:53] [V] [TRT] Tactic: 1703935 time 0.091848
[08/16/2021-04:55:53] [V] [TRT] Tactic: 1769471 time 0.152132
[08/16/2021-04:55:53] [V] [TRT] Tactic: 1966079 time 0.284568
[08/16/2021-04:55:53] [V] [TRT] Tactic: 2031615 time 0.211004
[08/16/2021-04:55:53] [V] [TRT] Tactic: 2228223 time 0.133172
[08/16/2021-04:55:53] [V] [TRT] Tactic: 2424831 time 0.096392
[08/16/2021-04:55:53] [V] [TRT] Tactic: 2621439 time 0.087628
[08/16/2021-04:55:54] [V] [TRT] Tactic: 2752511 time 0.177868
[08/16/2021-04:55:54] [V] [TRT] Tactic: 2818047 time 0.171224
[08/16/2021-04:55:54] [V] [TRT] Tactic: 2883583 time 0.291032
[08/16/2021-04:55:54] [V] [TRT] Tactic: 3014655 time 0.116032
[08/16/2021-04:55:54] [V] [TRT] Tactic: 3145727 time 0.136988
[08/16/2021-04:55:54] [V] [TRT] Tactic: 3473407 time 0.153392
[08/16/2021-04:55:54] [V] [TRT] Tactic: 3604479 time 0.11438
[08/16/2021-04:55:54] [V] [TRT] Tactic: 3735551 time 0.127548
[08/16/2021-04:55:54] [V] [TRT] Tactic: 4390911 time 0.258424
[08/16/2021-04:55:54] [V] [TRT] Tactic: 5046271 time 0.120744
[08/16/2021-04:55:54] [V] [TRT] Tactic: 5963775 time 0.223148
[08/16/2021-04:55:54] [V] [TRT] Tactic: 6160383 time 0.150824
[08/16/2021-04:55:54] [V] [TRT] Tactic: 6488063 time 0.235628
[08/16/2021-04:55:54] [V] [TRT] Tactic: 6881279 time 0.196556
[08/16/2021-04:55:54] [V] [TRT] Tactic: 7274495 time 0.117004
[08/16/2021-04:55:54] [V] [TRT] Tactic: 7864319 time 0.169808
[08/16/2021-04:55:54] [V] [TRT] Tactic: 7995391 time 0.152192
[08/16/2021-04:55:54] [V] [TRT] Tactic: 8585215 time 0.182752
[08/16/2021-04:55:54] [V] [TRT] Tactic: 8847359 time 0.22586
[08/16/2021-04:55:54] [V] [TRT] Tactic: 8978431 time 0.225256
[08/16/2021-04:55:54] [V] [TRT] Tactic: 9043967 time 0.189276
[08/16/2021-04:55:54] [V] [TRT] Tactic: 9175039 time 0.1154
[08/16/2021-04:55:54] [V] [TRT] Tactic: 9502719 time 0.25548
[08/16/2021-04:55:54] [V] [TRT] Tactic: 9830399 time 0.154864
[08/16/2021-04:55:54] [V] [TRT] Tactic: 9961471 time 0.124176
[08/16/2021-04:55:54] [V] [TRT] Tactic: 10027007 time 0.143672
[08/16/2021-04:55:54] [V] [TRT] Tactic: 10092543 time 0.258168
[08/16/2021-04:55:54] [V] [TRT] Tactic: 10289151 time 0.284056
[08/16/2021-04:55:54] [V] [TRT] Tactic: 10485759 time 0.139436
[08/16/2021-04:55:54] [V] [TRT] Tactic: 10682367 time 0.088164
[08/16/2021-04:55:54] [V] [TRT] Tactic: 10813439 time 0.089628
[08/16/2021-04:55:54] [V] [TRT] Fastest Tactic: 2621439 Time: 0.087628
[08/16/2021-04:55:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (CaskConvolution)
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:54] [V] [TRT] Tactic: 1145226902788474763 time 0.231572
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:54] [V] [TRT] Tactic: 2418518597804310654 time 0.224
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:54] [V] [TRT] Tactic: 8292881859266835088 time 0.271516
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:54] [V] [TRT] Tactic: 8401509141903434922 time 0.194968
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:54] [V] [TRT] Tactic: -8654297089785671176 time 0.285288
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:54] [V] [TRT] Tactic: -7448936905981214224 time 0.291796
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:54] [V] [TRT] Tactic: -3689982367035295496 time 0.288768
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:54] [V] [TRT] Tactic: -2027588946874785071 time 0.222112
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:54] [V] [TRT] Tactic: -245090590808296743 time 0.297216
[08/16/2021-04:55:54] [V] [TRT] Fastest Tactic: 8401509141903434922 Time: 0.194968
[08/16/2021-04:55:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (CudaConvolution)
[08/16/2021-04:55:54] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:54] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2621439
[08/16/2021-04:55:54] [V] [TRT] 
[08/16/2021-04:55:54] [V] [TRT] *************** Autotuning format combination: Half(32,256,1:8,2048) -> Float(1,8,64,16384) ***************
[08/16/2021-04:55:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:54] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (CaskConvolution)
[08/16/2021-04:55:54] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (CudaConvolution)
[08/16/2021-04:55:54] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:54] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:54] [V] [TRT] *************** Autotuning format combination: Half(32,256,1:8,2048) -> Half(32,256,1:8,2048) ***************
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:54] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (CaskConvolution)
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:54] [V] [TRT] Tactic: 3754069740140581927 time 0.118724
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:54] [V] [TRT] Tactic: 5925270497649423688 time 0.153948
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:54] [V] [TRT] Tactic: 6680916730816870145 time 0.09342
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:54] [V] [TRT] Tactic: 7158029511300006471 time 0.105924
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:54] [V] [TRT] Tactic: 7859952145590271433 time 0.09374
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:54] [V] [TRT] Tactic: 8283847742354150423 time 0.120236
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:54] [V] [TRT] Tactic: -4534876761957424274 time 0.154564
[08/16/2021-04:55:54] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:55] [V] [TRT] Tactic: -3237051169894153788 time 0.104816
[08/16/2021-04:55:55] [V] [TRT] Fastest Tactic: 6680916730816870145 Time: 0.09342
[08/16/2021-04:55:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (CudaConvolution)
[08/16/2021-04:55:55] [V] [TRT] Tactic: 0 time 5.69132
[08/16/2021-04:55:55] [V] [TRT] Tactic: 1 time 0.841032
[08/16/2021-04:55:55] [V] [TRT] Tactic: 2 time 0.309012
[08/16/2021-04:55:55] [V] [TRT] Tactic: 6 time 0.464364
[08/16/2021-04:55:55] [V] [TRT] Fastest Tactic: 2 Time: 0.309012
[08/16/2021-04:55:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6680916730816870145
[08/16/2021-04:55:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:55] [V] [TRT] 
[08/16/2021-04:55:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:55] [V] [TRT] *************** Autotuning format combination: Float(1,8,64,16384) -> Float(1,8,64,16384) ***************
[08/16/2021-04:55:55] [V] [TRT] *************** Autotuning format combination: Half(1,8,64,16384) -> Half(1,8,64,16384) ***************
[08/16/2021-04:55:55] [V] [TRT] *************** Autotuning format combination: Half(1,8,64:2,8192) -> Half(1,8,64:2,8192) ***************
[08/16/2021-04:55:55] [V] [TRT] *************** Autotuning format combination: Half(32,256,1:8,2048) -> Float(1,8,64,16384) ***************
[08/16/2021-04:55:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_4/Relu6 (FusedConvActConvolution)
[08/16/2021-04:55:55] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_4/Relu6 (CaskConvolution)
[08/16/2021-04:55:55] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_4/Relu6 (CudaConvolution)
[08/16/2021-04:55:55] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_4/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:55:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:55] [V] [TRT] *************** Autotuning format combination: Half(32,256,1:8,2048) -> Half(32,256,1:8,2048) ***************
[08/16/2021-04:55:55] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,24576) ***************
[08/16/2021-04:55:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:55:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:55:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:55:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:55:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:55:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:55:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:55:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:55:55] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:55:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (FusedConvActConvolution)
[08/16/2021-04:55:55] [V] [TRT] Tactic: 524287 time 0.328204
[08/16/2021-04:55:55] [V] [TRT] Tactic: 720895 time 0.538624
[08/16/2021-04:55:55] [V] [TRT] Tactic: 983039 time 0.454092
[08/16/2021-04:55:55] [V] [TRT] Tactic: 1048575 time 0.297132
[08/16/2021-04:55:55] [V] [TRT] Tactic: 1703935 time 0.244548
[08/16/2021-04:55:55] [V] [TRT] Tactic: 1769471 time 0.52524
[08/16/2021-04:55:55] [V] [TRT] Tactic: 1966079 time 0.618008
[08/16/2021-04:55:55] [V] [TRT] Tactic: 2031615 time 0.686752
[08/16/2021-04:55:55] [V] [TRT] Tactic: 2228223 time 0.265556
[08/16/2021-04:55:55] [V] [TRT] Tactic: 2424831 time 0.233804
[08/16/2021-04:55:55] [V] [TRT] Tactic: 2621439 time 0.257564
[08/16/2021-04:55:55] [V] [TRT] Tactic: 2752511 time 0.622628
[08/16/2021-04:55:55] [V] [TRT] Tactic: 2818047 time 0.97694
[08/16/2021-04:55:55] [V] [TRT] Tactic: 2883583 time 1.0526
[08/16/2021-04:55:55] [V] [TRT] Tactic: 3014655 time 0.263768
[08/16/2021-04:55:55] [V] [TRT] Tactic: 3145727 time 0.475956
[08/16/2021-04:55:55] [V] [TRT] Tactic: 3473407 time 1.04882
[08/16/2021-04:55:55] [V] [TRT] Tactic: 3604479 time 0.261252
[08/16/2021-04:55:55] [V] [TRT] Tactic: 3735551 time 0.996572
[08/16/2021-04:55:55] [V] [TRT] Tactic: 4390911 time 0.65282
[08/16/2021-04:55:55] [V] [TRT] Tactic: 5046271 time 0.276108
[08/16/2021-04:55:55] [V] [TRT] Tactic: 5963775 time 0.574768
[08/16/2021-04:55:56] [V] [TRT] Tactic: 6160383 time 0.315524
[08/16/2021-04:55:56] [V] [TRT] Tactic: 6488063 time 0.354568
[08/16/2021-04:55:56] [V] [TRT] Tactic: 6881279 time 0.596108
[08/16/2021-04:55:56] [V] [TRT] Tactic: 7274495 time 0.498096
[08/16/2021-04:55:56] [V] [TRT] Tactic: 7864319 time 0.26366
[08/16/2021-04:55:56] [V] [TRT] Tactic: 7995391 time 0.56884
[08/16/2021-04:55:56] [V] [TRT] Tactic: 8585215 time 0.374384
[08/16/2021-04:55:56] [V] [TRT] Tactic: 8847359 time 0.340084
[08/16/2021-04:55:56] [V] [TRT] Tactic: 8978431 time 0.57918
[08/16/2021-04:55:56] [V] [TRT] Tactic: 9043967 time 0.321936
[08/16/2021-04:55:56] [V] [TRT] Tactic: 9175039 time 0.261264
[08/16/2021-04:55:56] [V] [TRT] Tactic: 9502719 time 0.653772
[08/16/2021-04:55:56] [V] [TRT] Tactic: 9830399 time 0.935488
[08/16/2021-04:55:56] [V] [TRT] Tactic: 9961471 time 0.299856
[08/16/2021-04:55:56] [V] [TRT] Tactic: 10027007 time 0.33366
[08/16/2021-04:55:56] [V] [TRT] Tactic: 10092543 time 0.652828
[08/16/2021-04:55:56] [V] [TRT] Tactic: 10289151 time 0.618136
[08/16/2021-04:55:56] [V] [TRT] Tactic: 10485759 time 0.251712
[08/16/2021-04:55:56] [V] [TRT] Tactic: 10682367 time 0.245756
[08/16/2021-04:55:56] [V] [TRT] Tactic: 10813439 time 0.442876
[08/16/2021-04:55:56] [V] [TRT] Fastest Tactic: 2424831 Time: 0.233804
[08/16/2021-04:55:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (CaskConvolution)
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:55:56] [V] [TRT] Tactic: 1825138533642645384 time 1.09176
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:55:56] [V] [TRT] Tactic: 2775507031594384867 time 0.148248
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:55:56] [V] [TRT] Tactic: 2842488832350522458 time 0.570228
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:55:56] [V] [TRT] Tactic: 3915320020053085238 time 1.08519
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:55:56] [V] [TRT] Tactic: 6448355332020552203 time 1.1231
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:55:56] [V] [TRT] Tactic: 6808617066150061604 time 0.568724
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:55:56] [V] [TRT] Tactic: -8060443123034038864 time 0.588144
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:55:56] [V] [TRT] Tactic: -4420849921117327522 time 0.484492
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:55:56] [V] [TRT] Tactic: -3946921629105938337 time 0.54098
[08/16/2021-04:55:56] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.148248
[08/16/2021-04:55:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (CudaConvolution)
[08/16/2021-04:55:56] [V] [TRT] Tactic: 0 time 0.387716
[08/16/2021-04:55:56] [V] [TRT] Tactic: 2 time 0.60248
[08/16/2021-04:55:56] [V] [TRT] Tactic: 5 skipped. Scratch requested: 29175808, available: 16777216
[08/16/2021-04:55:56] [V] [TRT] Tactic: 6 time 0.178884
[08/16/2021-04:55:56] [V] [TRT] Tactic: 57 time 0.842124
[08/16/2021-04:55:56] [V] [TRT] Fastest Tactic: 6 Time: 0.178884
[08/16/2021-04:55:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (CudaDepthwiseConvolution)
[08/16/2021-04:55:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:55:56] [V] [TRT] 
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:55:56] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144) -> Half(1,32,1024,24576) ***************
[08/16/2021-04:55:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (FusedConvActConvolution)
[08/16/2021-04:55:56] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (CaskConvolution)
[08/16/2021-04:55:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (CudaConvolution)
[08/16/2021-04:55:56] [V] [TRT] Tactic: 0 time 0.387444
[08/16/2021-04:55:56] [V] [TRT] Tactic: 1 time 0.860164
[08/16/2021-04:55:56] [V] [TRT] Tactic: 2 time 0.449456
[08/16/2021-04:55:56] [V] [TRT] Tactic: 4 skipped. Scratch requested: 216489984, available: 16777216
[08/16/2021-04:55:56] [V] [TRT] Tactic: 5 skipped. Scratch requested: 29175808, available: 16777216
[08/16/2021-04:55:56] [V] [TRT] Tactic: 6 time 0.356044
[08/16/2021-04:55:56] [V] [TRT] Fastest Tactic: 6 Time: 0.356044
[08/16/2021-04:55:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (CudaDepthwiseConvolution)
[08/16/2021-04:55:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6
[08/16/2021-04:55:56] [V] [TRT] 
[08/16/2021-04:55:56] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072) -> Half(1,32,1024:2,12288) ***************
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:56] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (FusedConvActConvolution)
[08/16/2021-04:55:56] [V] [TRT] Tactic: 524287 time 0.167912
[08/16/2021-04:55:56] [V] [TRT] Tactic: 720895 time 0.342928
[08/16/2021-04:55:57] [V] [TRT] Tactic: 983039 time 0.238068
[08/16/2021-04:55:57] [V] [TRT] Tactic: 1048575 time 0.156628
[08/16/2021-04:55:57] [V] [TRT] Tactic: 1703935 time 0.133112
[08/16/2021-04:55:57] [V] [TRT] Tactic: 1769471 time 0.272912
[08/16/2021-04:55:57] [V] [TRT] Tactic: 1966079 time 0.331636
[08/16/2021-04:55:57] [V] [TRT] Tactic: 2031615 time 0.352472
[08/16/2021-04:55:57] [V] [TRT] Tactic: 2228223 time 0.137436
[08/16/2021-04:55:57] [V] [TRT] Tactic: 2424831 time 0.123088
[08/16/2021-04:55:57] [V] [TRT] Tactic: 2621439 time 0.132488
[08/16/2021-04:55:57] [V] [TRT] Tactic: 2752511 time 0.339732
[08/16/2021-04:55:57] [V] [TRT] Tactic: 2818047 time 0.496928
[08/16/2021-04:55:57] [V] [TRT] Tactic: 2883583 time 0.539364
[08/16/2021-04:55:57] [V] [TRT] Tactic: 3014655 time 0.142928
[08/16/2021-04:55:57] [V] [TRT] Tactic: 3145727 time 0.246976
[08/16/2021-04:55:57] [V] [TRT] Tactic: 3473407 time 0.457812
[08/16/2021-04:55:57] [V] [TRT] Tactic: 3604479 time 0.14158
[08/16/2021-04:55:57] [V] [TRT] Tactic: 3735551 time 0.460108
[08/16/2021-04:55:57] [V] [TRT] Tactic: 4390911 time 0.338588
[08/16/2021-04:55:57] [V] [TRT] Tactic: 5046271 time 0.152248
[08/16/2021-04:55:57] [V] [TRT] Tactic: 5963775 time 0.297744
[08/16/2021-04:55:57] [V] [TRT] Tactic: 6160383 time 0.157348
[08/16/2021-04:55:57] [V] [TRT] Tactic: 6488063 time 0.182284
[08/16/2021-04:55:57] [V] [TRT] Tactic: 6881279 time 0.310704
[08/16/2021-04:55:57] [V] [TRT] Tactic: 7274495 time 0.249948
[08/16/2021-04:55:57] [V] [TRT] Tactic: 7864319 time 0.138864
[08/16/2021-04:55:57] [V] [TRT] Tactic: 7995391 time 0.22586
[08/16/2021-04:55:57] [V] [TRT] Tactic: 8585215 time 0.189876
[08/16/2021-04:55:57] [V] [TRT] Tactic: 8847359 time 0.172384
[08/16/2021-04:55:57] [V] [TRT] Tactic: 8978431 time 0.295416
[08/16/2021-04:55:57] [V] [TRT] Tactic: 9043967 time 0.15288
[08/16/2021-04:55:57] [V] [TRT] Tactic: 9175039 time 0.142688
[08/16/2021-04:55:57] [V] [TRT] Tactic: 9502719 time 0.335016
[08/16/2021-04:55:57] [V] [TRT] Tactic: 9830399 time 0.474088
[08/16/2021-04:55:57] [V] [TRT] Tactic: 9961471 time 0.152536
[08/16/2021-04:55:57] [V] [TRT] Tactic: 10027007 time 0.178292
[08/16/2021-04:55:57] [V] [TRT] Tactic: 10092543 time 0.337992
[08/16/2021-04:55:57] [V] [TRT] Tactic: 10289151 time 0.329924
[08/16/2021-04:55:57] [V] [TRT] Tactic: 10485759 time 0.133652
[08/16/2021-04:55:57] [V] [TRT] Tactic: 10682367 time 0.129812
[08/16/2021-04:55:57] [V] [TRT] Tactic: 10813439 time 0.23334
[08/16/2021-04:55:57] [V] [TRT] Fastest Tactic: 2424831 Time: 0.123088
[08/16/2021-04:55:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (CaskConvolution)
[08/16/2021-04:55:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:57] [V] [TRT] Tactic: 1145226902788474763 time 0.311692
[08/16/2021-04:55:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:58] [V] [TRT] Tactic: 2418518597804310654 time 0.306744
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:58] [V] [TRT] Tactic: 8292881859266835088 time 0.256948
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:58] [V] [TRT] Tactic: 8401509141903434922 time 0.294216
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:58] [V] [TRT] Tactic: -8654297089785671176 time 0.564856
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:58] [V] [TRT] Tactic: -7448936905981214224 time 0.281964
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:58] [V] [TRT] Tactic: -3689982367035295496 time 0.572556
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:55:58] [V] [TRT] Tactic: -3140347171730126532 time 0.079132
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:58] [V] [TRT] Tactic: -2027588946874785071 time 0.212168
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:58] [V] [TRT] Tactic: -245090590808296743 time 0.582084
[08/16/2021-04:55:58] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.079132
[08/16/2021-04:55:58] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (CudaConvolution)
[08/16/2021-04:55:58] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:58] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (CudaDepthwiseConvolution)
[08/16/2021-04:55:58] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:55:58] [V] [TRT] 
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:55:58] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Float(1,32,1024,24576) ***************
[08/16/2021-04:55:58] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (FusedConvActConvolution)
[08/16/2021-04:55:58] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:58] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (CaskConvolution)
[08/16/2021-04:55:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:58] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (CudaConvolution)
[08/16/2021-04:55:58] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:58] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (CudaDepthwiseConvolution)
[08/16/2021-04:55:58] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:58] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Half(3,96,1:8,3072) ***************
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (FusedConvActConvolution)
[08/16/2021-04:55:58] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:58] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (CaskConvolution)
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] Tactic: 3754069740140581927 time 0.166792
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] Tactic: 5925270497649423688 time 0.158232
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] Tactic: 6680916730816870145 time 0.099788
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] Tactic: 7158029511300006471 time 0.11636
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] Tactic: 7859952145590271433 time 0.100752
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] Tactic: 8283847742354150423 time 0.165424
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] Tactic: -4534876761957424274 time 0.15706
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] Tactic: -3237051169894153788 time 0.115064
[08/16/2021-04:55:58] [V] [TRT] Fastest Tactic: 6680916730816870145 Time: 0.099788
[08/16/2021-04:55:58] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (CudaConvolution)
[08/16/2021-04:55:58] [V] [TRT] Tactic: 0 time 8.76366
[08/16/2021-04:55:58] [V] [TRT] Tactic: 1 time 0.89462
[08/16/2021-04:55:58] [V] [TRT] Tactic: 2 time 0.717116
[08/16/2021-04:55:58] [V] [TRT] Tactic: 6 time 0.27824
[08/16/2021-04:55:58] [V] [TRT] Fastest Tactic: 6 Time: 0.27824
[08/16/2021-04:55:58] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (CudaDepthwiseConvolution)
[08/16/2021-04:55:58] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:55:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6680916730816870145
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] 
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:55:58] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,559104) ***************
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:55:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:55:58] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (FusedConvActConvolution)
[08/16/2021-04:55:58] [V] [TRT] Tactic: 524287 time 5.0102
[08/16/2021-04:55:58] [V] [TRT] Tactic: 720895 time 4.82258
[08/16/2021-04:55:59] [V] [TRT] Tactic: 983039 time 4.93486
[08/16/2021-04:55:59] [V] [TRT] Tactic: 1048575 time 4.56997
[08/16/2021-04:55:59] [V] [TRT] Tactic: 1703935 time 4.52171
[08/16/2021-04:55:59] [V] [TRT] Tactic: 1769471 time 5.42235
[08/16/2021-04:55:59] [V] [TRT] Tactic: 1966079 time 3.60764
[08/16/2021-04:56:00] [V] [TRT] Tactic: 2031615 time 4.82145
[08/16/2021-04:56:00] [V] [TRT] Tactic: 2228223 time 4.12764
[08/16/2021-04:56:00] [V] [TRT] Tactic: 2424831 time 4.21924
[08/16/2021-04:56:00] [V] [TRT] Tactic: 2621439 time 4.43656
[08/16/2021-04:56:01] [V] [TRT] Tactic: 2752511 time 4.438
[08/16/2021-04:56:01] [V] [TRT] Tactic: 3014655 time 3.94896
[08/16/2021-04:56:01] [V] [TRT] Tactic: 3145727 time 4.36133
[08/16/2021-04:56:01] [V] [TRT] Tactic: 3604479 time 3.93547
[08/16/2021-04:56:01] [V] [TRT] Tactic: 4390911 time 4.58861
[08/16/2021-04:56:02] [V] [TRT] Tactic: 5046271 time 6.09418
[08/16/2021-04:56:02] [V] [TRT] Tactic: 5963775 time 4.17123
[08/16/2021-04:56:02] [V] [TRT] Tactic: 6160383 time 5.1232
[08/16/2021-04:56:02] [V] [TRT] Tactic: 6488063 time 4.43007
[08/16/2021-04:56:02] [V] [TRT] Tactic: 6881279 time 5.19158
[08/16/2021-04:56:03] [V] [TRT] Tactic: 7274495 time 6.10134
[08/16/2021-04:56:03] [V] [TRT] Tactic: 7864319 time 4.88493
[08/16/2021-04:56:03] [V] [TRT] Tactic: 7995391 time 3.71923
[08/16/2021-04:56:03] [V] [TRT] Tactic: 8585215 time 4.67585
[08/16/2021-04:56:04] [V] [TRT] Tactic: 8847359 time 5.50442
[08/16/2021-04:56:04] [V] [TRT] Tactic: 8978431 time 4.23123
[08/16/2021-04:56:04] [V] [TRT] Tactic: 9043967 time 4.39323
[08/16/2021-04:56:04] [V] [TRT] Tactic: 9175039 time 3.92746
[08/16/2021-04:56:04] [V] [TRT] Tactic: 9502719 time 4.52175
[08/16/2021-04:56:05] [V] [TRT] Tactic: 9961471 time 4.63303
[08/16/2021-04:56:05] [V] [TRT] Tactic: 10027007 time 5.12604
[08/16/2021-04:56:05] [V] [TRT] Tactic: 10092543 time 4.59079
[08/16/2021-04:56:05] [V] [TRT] Tactic: 10289151 time 3.61723
[08/16/2021-04:56:06] [V] [TRT] Tactic: 10485759 time 5.23653
[08/16/2021-04:56:06] [V] [TRT] Tactic: 10682367 time 4.35977
[08/16/2021-04:56:06] [V] [TRT] Tactic: 10813439 time 3.71082
[08/16/2021-04:56:06] [V] [TRT] Fastest Tactic: 1966079 Time: 3.60764
[08/16/2021-04:56:06] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CaskConvolution)
[08/16/2021-04:56:06] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:56:06] [V] [TRT] Tactic: 1825138533642645384 time 3.8924
[08/16/2021-04:56:06] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:06] [V] [TRT] Tactic: 2775507031594384867 time 1.80857
[08/16/2021-04:56:06] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:56:06] [V] [TRT] Tactic: 2842488832350522458 time 3.29572
[08/16/2021-04:56:06] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:56:06] [V] [TRT] Tactic: 3915320020053085238 time 3.8677
[08/16/2021-04:56:06] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:56:06] [V] [TRT] Tactic: 6448355332020552203 time 3.92722
[08/16/2021-04:56:06] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:56:06] [V] [TRT] Tactic: 6808617066150061604 time 3.34771
[08/16/2021-04:56:06] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:56:06] [V] [TRT] Tactic: -8060443123034038864 time 3.37226
[08/16/2021-04:56:06] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:56:06] [V] [TRT] Tactic: -4420849921117327522 time 3.63657
[08/16/2021-04:56:06] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:56:07] [V] [TRT] Tactic: -3946921629105938337 time 3.62944
[08/16/2021-04:56:07] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 1.80857
[08/16/2021-04:56:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CudaConvolution)
[08/16/2021-04:56:07] [V] [TRT] Tactic: 0 time 5.27467
[08/16/2021-04:56:07] [V] [TRT] Tactic: 2 time 5.27705
[08/16/2021-04:56:07] [V] [TRT] Tactic: 5 skipped. Scratch requested: 615285760, available: 16777216
[08/16/2021-04:56:07] [V] [TRT] Tactic: 6 time 2.27986
[08/16/2021-04:56:07] [V] [TRT] Tactic: 57 time 5.73568
[08/16/2021-04:56:07] [V] [TRT] Fastest Tactic: 6 Time: 2.27986
[08/16/2021-04:56:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CudaDepthwiseConvolution)
[08/16/2021-04:56:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:07] [V] [TRT] 
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:07] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,262144) -> Half(1,32,1024,559104) ***************
[08/16/2021-04:56:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (FusedConvActConvolution)
[08/16/2021-04:56:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CaskConvolution)
[08/16/2021-04:56:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CudaConvolution)
[08/16/2021-04:56:07] [V] [TRT] Tactic: 0 time 5.51934
[08/16/2021-04:56:07] [V] [TRT] Tactic: 1 time 3.98476
[08/16/2021-04:56:07] [V] [TRT] Tactic: 2 time 4.69136
[08/16/2021-04:56:07] [V] [TRT] Tactic: 4 skipped. Scratch requested: 4736993280, available: 16777216
[08/16/2021-04:56:07] [V] [TRT] Tactic: 5 skipped. Scratch requested: 615285760, available: 16777216
[08/16/2021-04:56:07] [V] [TRT] Tactic: 6 skipped. Scratch requested: 22788608, available: 16777216
[08/16/2021-04:56:07] [V] [TRT] Fastest Tactic: 1 Time: 3.98476
[08/16/2021-04:56:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CudaDepthwiseConvolution)
[08/16/2021-04:56:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:56:07] [V] [TRT] 
[08/16/2021-04:56:07] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024:2,131072) -> Half(1,32,1024:2,279552) ***************
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (FusedConvActConvolution)
[08/16/2021-04:56:07] [V] [TRT] Tactic: 524287 time 2.53556
[08/16/2021-04:56:07] [V] [TRT] Tactic: 720895 time 2.50396
[08/16/2021-04:56:08] [V] [TRT] Tactic: 983039 time 2.2944
[08/16/2021-04:56:08] [V] [TRT] Tactic: 1048575 time 2.47174
[08/16/2021-04:56:08] [V] [TRT] Tactic: 1703935 time 2.41864
[08/16/2021-04:56:08] [V] [TRT] Tactic: 1769471 time 2.75589
[08/16/2021-04:56:08] [V] [TRT] Tactic: 1966079 time 1.84794
[08/16/2021-04:56:08] [V] [TRT] Tactic: 2031615 time 2.24635
[08/16/2021-04:56:08] [V] [TRT] Tactic: 2228223 time 2.10995
[08/16/2021-04:56:08] [V] [TRT] Tactic: 2424831 time 2.13987
[08/16/2021-04:56:09] [V] [TRT] Tactic: 2621439 time 2.24044
[08/16/2021-04:56:09] [V] [TRT] Tactic: 2752511 time 2.34434
[08/16/2021-04:56:09] [V] [TRT] Tactic: 3014655 time 1.95242
[08/16/2021-04:56:09] [V] [TRT] Tactic: 3145727 time 2.23744
[08/16/2021-04:56:09] [V] [TRT] Tactic: 3604479 time 1.95406
[08/16/2021-04:56:09] [V] [TRT] Tactic: 4390911 time 2.28501
[08/16/2021-04:56:09] [V] [TRT] Tactic: 5046271 time 3.15658
[08/16/2021-04:56:09] [V] [TRT] Tactic: 5963775 time 2.00641
[08/16/2021-04:56:09] [V] [TRT] Tactic: 6160383 time 2.46822
[08/16/2021-04:56:10] [V] [TRT] Tactic: 6488063 time 2.22169
[08/16/2021-04:56:10] [V] [TRT] Tactic: 6881279 time 2.39425
[08/16/2021-04:56:10] [V] [TRT] Tactic: 7274495 time 2.72242
[08/16/2021-04:56:10] [V] [TRT] Tactic: 7864319 time 2.49389
[08/16/2021-04:56:10] [V] [TRT] Tactic: 7995391 time 2.02074
[08/16/2021-04:56:10] [V] [TRT] Tactic: 8585215 time 2.59709
[08/16/2021-04:56:10] [V] [TRT] Tactic: 8847359 time 2.89306
[08/16/2021-04:56:10] [V] [TRT] Tactic: 8978431 time 2.04017
[08/16/2021-04:56:11] [V] [TRT] Tactic: 9043967 time 2.16125
[08/16/2021-04:56:11] [V] [TRT] Tactic: 9175039 time 1.95238
[08/16/2021-04:56:11] [V] [TRT] Tactic: 9502719 time 2.26988
[08/16/2021-04:56:11] [V] [TRT] Tactic: 9961471 time 2.3862
[08/16/2021-04:56:11] [V] [TRT] Tactic: 10027007 time 2.73385
[08/16/2021-04:56:11] [V] [TRT] Tactic: 10092543 time 2.28703
[08/16/2021-04:56:11] [V] [TRT] Tactic: 10289151 time 1.8434
[08/16/2021-04:56:11] [V] [TRT] Tactic: 10485759 time 2.71498
[08/16/2021-04:56:12] [V] [TRT] Tactic: 10682367 time 2.20788
[08/16/2021-04:56:12] [V] [TRT] Tactic: 10813439 time 1.92308
[08/16/2021-04:56:12] [V] [TRT] Fastest Tactic: 10289151 Time: 1.8434
[08/16/2021-04:56:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CaskConvolution)
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:12] [V] [TRT] Tactic: 1145226902788474763 time 1.71882
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:12] [V] [TRT] Tactic: 2418518597804310654 time 1.72066
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:12] [V] [TRT] Tactic: 8292881859266835088 time 2.02862
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:12] [V] [TRT] Tactic: 8401509141903434922 time 1.69466
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:12] [V] [TRT] Tactic: -8654297089785671176 time 1.96918
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:12] [V] [TRT] Tactic: -7448936905981214224 time 2.08546
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:12] [V] [TRT] Tactic: -3689982367035295496 time 1.99514
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:12] [V] [TRT] Tactic: -3140347171730126532 time 0.923328
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:12] [V] [TRT] Tactic: -2027588946874785071 time 2.00173
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:12] [V] [TRT] Tactic: -245090590808296743 time 2.03093
[08/16/2021-04:56:12] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.923328
[08/16/2021-04:56:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CudaConvolution)
[08/16/2021-04:56:12] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CudaDepthwiseConvolution)
[08/16/2021-04:56:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:12] [V] [TRT] 
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:12] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Float(1,32,1024,559104) ***************
[08/16/2021-04:56:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (FusedConvActConvolution)
[08/16/2021-04:56:12] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CaskConvolution)
[08/16/2021-04:56:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CudaConvolution)
[08/16/2021-04:56:12] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CudaDepthwiseConvolution)
[08/16/2021-04:56:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:12] [V] [TRT] *************** Autotuning format combination: Half(32,1024,1:8,32768) -> Half(69,2208,1:8,70656) ***************
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (FusedConvActConvolution)
[08/16/2021-04:56:12] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CaskConvolution)
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] Tactic: 3754069740140581927 time 0.639112
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] Tactic: 5925270497649423688 time 0.633836
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] Tactic: 6680916730816870145 time 0.580116
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] Tactic: 7158029511300006471 time 0.547012
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] Tactic: 7859952145590271433 time 0.583516
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] Tactic: 8283847742354150423 time 0.638352
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] Tactic: -4534876761957424274 time 0.641036
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] Tactic: -3237051169894153788 time 0.536568
[08/16/2021-04:56:12] [V] [TRT] Fastest Tactic: -3237051169894153788 Time: 0.536568
[08/16/2021-04:56:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CudaConvolution)
[08/16/2021-04:56:12] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CudaDepthwiseConvolution)
[08/16/2021-04:56:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3237051169894153788
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] 
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:12] [V] [TRT] *************** Autotuning format combination: Float(1,8,64,16384) -> Float(1,8,64,16384) ***************
[08/16/2021-04:56:12] [V] [TRT] *************** Autotuning format combination: Half(1,8,64,16384) -> Half(1,8,64,16384) ***************
[08/16/2021-04:56:12] [V] [TRT] *************** Autotuning format combination: Half(1,8,64:2,8192) -> Half(1,8,64:2,8192) ***************
[08/16/2021-04:56:12] [V] [TRT] *************** Autotuning format combination: Half(32,256,1:8,2048) -> Float(1,8,64,16384) ***************
[08/16/2021-04:56:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_4/Relu6 (FusedConvActConvolution)
[08/16/2021-04:56:12] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_4/Relu6 (CaskConvolution)
[08/16/2021-04:56:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_4/Relu6 (CudaConvolution)
[08/16/2021-04:56:12] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_4/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:56:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:12] [V] [TRT] *************** Autotuning format combination: Half(32,256,1:8,2048) -> Half(32,256,1:8,2048) ***************
[08/16/2021-04:56:12] [V] [TRT] *************** Autotuning format combination: Float(1,8,64,16384) -> Float(1,8,64,16384) ***************
[08/16/2021-04:56:12] [V] [TRT] *************** Autotuning format combination: Half(1,8,64,16384) -> Half(1,8,64,16384) ***************
[08/16/2021-04:56:12] [V] [TRT] *************** Autotuning format combination: Half(1,8,64:2,8192) -> Half(1,8,64:2,8192) ***************
[08/16/2021-04:56:12] [V] [TRT] *************** Autotuning format combination: Half(32,256,1:8,2048) -> Float(1,8,64,16384) ***************
[08/16/2021-04:56:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_4/Relu6 (FusedConvActConvolution)
[08/16/2021-04:56:12] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_4/Relu6 (CaskConvolution)
[08/16/2021-04:56:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_4/Relu6 (CudaConvolution)
[08/16/2021-04:56:12] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_4/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:56:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:12] [V] [TRT] *************** Autotuning format combination: Half(32,256,1:8,2048) -> Half(32,256,1:8,2048) ***************
[08/16/2021-04:56:12] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,65536) -> Float(1,16,256,6144) ***************
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:56:12] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:56:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (FusedConvActConvolution)
[08/16/2021-04:56:12] [V] [TRT] Tactic: 524287 time 0.227116
[08/16/2021-04:56:12] [V] [TRT] Tactic: 720895 time 0.281304
[08/16/2021-04:56:12] [V] [TRT] Tactic: 983039 time 0.138208
[08/16/2021-04:56:12] [V] [TRT] Tactic: 1048575 time 0.149552
[08/16/2021-04:56:12] [V] [TRT] Tactic: 1703935 time 0.108296
[08/16/2021-04:56:12] [V] [TRT] Tactic: 1769471 time 0.172692
[08/16/2021-04:56:12] [V] [TRT] Tactic: 1966079 time 0.367644
[08/16/2021-04:56:12] [V] [TRT] Tactic: 2031615 time 0.309004
[08/16/2021-04:56:13] [V] [TRT] Tactic: 2228223 time 0.190264
[08/16/2021-04:56:13] [V] [TRT] Tactic: 2424831 time 0.068104
[08/16/2021-04:56:13] [V] [TRT] Tactic: 2621439 time 0.103016
[08/16/2021-04:56:13] [V] [TRT] Tactic: 2752511 time 0.322792
[08/16/2021-04:56:13] [V] [TRT] Tactic: 2818047 time 0.32102
[08/16/2021-04:56:13] [V] [TRT] Tactic: 2883583 time 0.453336
[08/16/2021-04:56:13] [V] [TRT] Tactic: 3014655 time 0.09866
[08/16/2021-04:56:13] [V] [TRT] Tactic: 3145727 time 0.168012
[08/16/2021-04:56:13] [V] [TRT] Tactic: 3473407 time 0.365248
[08/16/2021-04:56:13] [V] [TRT] Tactic: 3604479 time 0.097528
[08/16/2021-04:56:13] [V] [TRT] Tactic: 3735551 time 0.279324
[08/16/2021-04:56:13] [V] [TRT] Tactic: 4390911 time 0.39782
[08/16/2021-04:56:13] [V] [TRT] Tactic: 5046271 time 0.150312
[08/16/2021-04:56:13] [V] [TRT] Tactic: 5963775 time 0.341356
[08/16/2021-04:56:13] [V] [TRT] Tactic: 6160383 time 0.20824
[08/16/2021-04:56:13] [V] [TRT] Tactic: 6488063 time 0.238216
[08/16/2021-04:56:13] [V] [TRT] Tactic: 6881279 time 0.283088
[08/16/2021-04:56:13] [V] [TRT] Tactic: 7274495 time 0.149872
[08/16/2021-04:56:13] [V] [TRT] Tactic: 7864319 time 0.109308
[08/16/2021-04:56:13] [V] [TRT] Tactic: 7995391 time 0.295092
[08/16/2021-04:56:13] [V] [TRT] Tactic: 8585215 time 0.255696
[08/16/2021-04:56:13] [V] [TRT] Tactic: 8847359 time 0.129092
[08/16/2021-04:56:13] [V] [TRT] Tactic: 8978431 time 0.337276
[08/16/2021-04:56:13] [V] [TRT] Tactic: 9043967 time 0.126216
[08/16/2021-04:56:13] [V] [TRT] Tactic: 9175039 time 0.097872
[08/16/2021-04:56:13] [V] [TRT] Tactic: 9502719 time 0.396648
[08/16/2021-04:56:13] [V] [TRT] Tactic: 9830399 time 0.264556
[08/16/2021-04:56:13] [V] [TRT] Tactic: 9961471 time 0.077196
[08/16/2021-04:56:13] [V] [TRT] Tactic: 10027007 time 0.179952
[08/16/2021-04:56:13] [V] [TRT] Tactic: 10092543 time 0.397768
[08/16/2021-04:56:13] [V] [TRT] Tactic: 10289151 time 0.367584
[08/16/2021-04:56:13] [V] [TRT] Tactic: 10485759 time 0.09958
[08/16/2021-04:56:13] [V] [TRT] Tactic: 10682367 time 0.102316
[08/16/2021-04:56:13] [V] [TRT] Tactic: 10813439 time 0.154316
[08/16/2021-04:56:13] [V] [TRT] Fastest Tactic: 2424831 Time: 0.068104
[08/16/2021-04:56:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (CaskConvolution)
[08/16/2021-04:56:13] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:56:13] [V] [TRT] Tactic: 1825138533642645384 time 0.571296
[08/16/2021-04:56:13] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:13] [V] [TRT] Tactic: 2775507031594384867 time 0.081204
[08/16/2021-04:56:13] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:56:13] [V] [TRT] Tactic: 2842488832350522458 time 0.375348
[08/16/2021-04:56:13] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:56:13] [V] [TRT] Tactic: 3915320020053085238 time 0.552572
[08/16/2021-04:56:13] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:56:13] [V] [TRT] Tactic: 6448355332020552203 time 0.57308
[08/16/2021-04:56:13] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:56:13] [V] [TRT] Tactic: 6808617066150061604 time 0.320832
[08/16/2021-04:56:13] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:56:13] [V] [TRT] Tactic: -8060443123034038864 time 0.384804
[08/16/2021-04:56:13] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:56:13] [V] [TRT] Tactic: -4420849921117327522 time 0.335448
[08/16/2021-04:56:13] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:56:13] [V] [TRT] Tactic: -3946921629105938337 time 0.395712
[08/16/2021-04:56:13] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.081204
[08/16/2021-04:56:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (CudaConvolution)
[08/16/2021-04:56:13] [V] [TRT] Tactic: 0 time 0.234628
[08/16/2021-04:56:13] [V] [TRT] Tactic: 2 time 0.371716
[08/16/2021-04:56:13] [V] [TRT] Tactic: 5 skipped. Scratch requested: 27957248, available: 16777216
[08/16/2021-04:56:13] [V] [TRT] Tactic: 6 time 0.108644
[08/16/2021-04:56:13] [V] [TRT] Tactic: 57 time 0.60186
[08/16/2021-04:56:13] [V] [TRT] Fastest Tactic: 6 Time: 0.108644
[08/16/2021-04:56:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (CudaDepthwiseConvolution)
[08/16/2021-04:56:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2424831
[08/16/2021-04:56:13] [V] [TRT] 
[08/16/2021-04:56:13] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,65536) -> Half(1,16,256,6144) ***************
[08/16/2021-04:56:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (FusedConvActConvolution)
[08/16/2021-04:56:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (CaskConvolution)
[08/16/2021-04:56:13] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (CudaConvolution)
[08/16/2021-04:56:13] [V] [TRT] Tactic: 0 time 0.207924
[08/16/2021-04:56:13] [V] [TRT] Tactic: 1 time 0.694864
[08/16/2021-04:56:13] [V] [TRT] Tactic: 2 time 0.31568
[08/16/2021-04:56:13] [V] [TRT] Tactic: 4 skipped. Scratch requested: 55926784, available: 16777216
[08/16/2021-04:56:13] [V] [TRT] Tactic: 5 skipped. Scratch requested: 27957248, available: 16777216
[08/16/2021-04:56:13] [V] [TRT] Tactic: 6 time 0.2582
[08/16/2021-04:56:13] [V] [TRT] Fastest Tactic: 0 Time: 0.207924
[08/16/2021-04:56:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (CudaDepthwiseConvolution)
[08/16/2021-04:56:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0
[08/16/2021-04:56:13] [V] [TRT] 
[08/16/2021-04:56:13] [V] [TRT] *************** Autotuning format combination: Half(1,16,256:2,32768) -> Half(1,16,256:2,3072) ***************
[08/16/2021-04:56:13] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:13] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:13] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:13] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:13] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:13] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:13] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:13] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:13] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:13] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (FusedConvActConvolution)
[08/16/2021-04:56:13] [V] [TRT] Tactic: 524287 time 0.103096
[08/16/2021-04:56:14] [V] [TRT] Tactic: 720895 time 0.139944
[08/16/2021-04:56:14] [V] [TRT] Tactic: 983039 time 0.07308
[08/16/2021-04:56:14] [V] [TRT] Tactic: 1048575 time 0.069712
[08/16/2021-04:56:14] [V] [TRT] Tactic: 1703935 time 0.059276
[08/16/2021-04:56:14] [V] [TRT] Tactic: 1769471 time 0.089632
[08/16/2021-04:56:14] [V] [TRT] Tactic: 1966079 time 0.180992
[08/16/2021-04:56:14] [V] [TRT] Tactic: 2031615 time 0.149936
[08/16/2021-04:56:14] [V] [TRT] Tactic: 2228223 time 0.101036
[08/16/2021-04:56:14] [V] [TRT] Tactic: 2424831 time 0.037108
[08/16/2021-04:56:14] [V] [TRT] Tactic: 2621439 time 0.054916
[08/16/2021-04:56:14] [V] [TRT] Tactic: 2752511 time 0.165736
[08/16/2021-04:56:14] [V] [TRT] Tactic: 2818047 time 0.166436
[08/16/2021-04:56:14] [V] [TRT] Tactic: 2883583 time 0.228448
[08/16/2021-04:56:14] [V] [TRT] Tactic: 3014655 time 0.048616
[08/16/2021-04:56:14] [V] [TRT] Tactic: 3145727 time 0.089384
[08/16/2021-04:56:14] [V] [TRT] Tactic: 3473407 time 0.187252
[08/16/2021-04:56:14] [V] [TRT] Tactic: 3604479 time 0.048628
[08/16/2021-04:56:14] [V] [TRT] Tactic: 3735551 time 0.14648
[08/16/2021-04:56:14] [V] [TRT] Tactic: 4390911 time 0.194968
[08/16/2021-04:56:14] [V] [TRT] Tactic: 5046271 time 0.08306
[08/16/2021-04:56:14] [V] [TRT] Tactic: 5963775 time 0.162208
[08/16/2021-04:56:14] [V] [TRT] Tactic: 6160383 time 0.096568
[08/16/2021-04:56:14] [V] [TRT] Tactic: 6488063 time 0.124124
[08/16/2021-04:56:14] [V] [TRT] Tactic: 6881279 time 0.132352
[08/16/2021-04:56:14] [V] [TRT] Tactic: 7274495 time 0.079952
[08/16/2021-04:56:14] [V] [TRT] Tactic: 7864319 time 0.058372
[08/16/2021-04:56:14] [V] [TRT] Tactic: 7995391 time 0.095504
[08/16/2021-04:56:14] [V] [TRT] Tactic: 8585215 time 0.118808
[08/16/2021-04:56:14] [V] [TRT] Tactic: 8847359 time 0.068228
[08/16/2021-04:56:14] [V] [TRT] Tactic: 8978431 time 0.16328
[08/16/2021-04:56:14] [V] [TRT] Tactic: 9043967 time 0.068144
[08/16/2021-04:56:14] [V] [TRT] Tactic: 9175039 time 0.048868
[08/16/2021-04:56:14] [V] [TRT] Tactic: 9502719 time 0.192796
[08/16/2021-04:56:14] [V] [TRT] Tactic: 9830399 time 0.133732
[08/16/2021-04:56:14] [V] [TRT] Tactic: 9961471 time 0.041048
[08/16/2021-04:56:14] [V] [TRT] Tactic: 10027007 time 0.0956
[08/16/2021-04:56:14] [V] [TRT] Tactic: 10092543 time 0.195696
[08/16/2021-04:56:14] [V] [TRT] Tactic: 10289151 time 0.18104
[08/16/2021-04:56:14] [V] [TRT] Tactic: 10485759 time 0.051348
[08/16/2021-04:56:14] [V] [TRT] Tactic: 10682367 time 0.054504
[08/16/2021-04:56:14] [V] [TRT] Tactic: 10813439 time 0.08308
[08/16/2021-04:56:14] [V] [TRT] Fastest Tactic: 2424831 Time: 0.037108
[08/16/2021-04:56:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (CaskConvolution)
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:14] [V] [TRT] Tactic: 1145226902788474763 time 0.203052
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:14] [V] [TRT] Tactic: 2418518597804310654 time 0.198168
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:14] [V] [TRT] Tactic: 8292881859266835088 time 0.219996
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:14] [V] [TRT] Tactic: 8401509141903434922 time 0.163584
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:14] [V] [TRT] Tactic: -8654297089785671176 time 0.284204
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:14] [V] [TRT] Tactic: -7448936905981214224 time 0.2336
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:14] [V] [TRT] Tactic: -3689982367035295496 time 0.298464
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:14] [V] [TRT] Tactic: -3140347171730126532 time 0.04182
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:14] [V] [TRT] Tactic: -2027588946874785071 time 0.16504
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:14] [V] [TRT] Tactic: -245090590808296743 time 0.297792
[08/16/2021-04:56:14] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.04182
[08/16/2021-04:56:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (CudaConvolution)
[08/16/2021-04:56:14] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (CudaDepthwiseConvolution)
[08/16/2021-04:56:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2424831
[08/16/2021-04:56:14] [V] [TRT] 
[08/16/2021-04:56:14] [V] [TRT] *************** Autotuning format combination: Half(32,512,1:8,8192) -> Float(1,16,256,6144) ***************
[08/16/2021-04:56:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (FusedConvActConvolution)
[08/16/2021-04:56:14] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (CaskConvolution)
[08/16/2021-04:56:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (CudaConvolution)
[08/16/2021-04:56:14] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (CudaDepthwiseConvolution)
[08/16/2021-04:56:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:14] [V] [TRT] *************** Autotuning format combination: Half(32,512,1:8,8192) -> Half(3,48,1:8,768) ***************
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (FusedConvActConvolution)
[08/16/2021-04:56:14] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (CaskConvolution)
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] Tactic: 3754069740140581927 time 0.09832
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] Tactic: 5925270497649423688 time 0.151872
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] Tactic: 6680916730816870145 time 0.091592
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] Tactic: 7158029511300006471 time 0.09954
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] Tactic: 7859952145590271433 time 0.09196
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] Tactic: 8283847742354150423 time 0.0995
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] Tactic: -4534876761957424274 time 0.151312
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] Tactic: -3237051169894153788 time 0.097796
[08/16/2021-04:56:14] [V] [TRT] Fastest Tactic: 6680916730816870145 Time: 0.091592
[08/16/2021-04:56:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (CudaConvolution)
[08/16/2021-04:56:14] [V] [TRT] Tactic: 0 time 0.283748
[08/16/2021-04:56:14] [V] [TRT] Tactic: 1 time 0.648672
[08/16/2021-04:56:14] [V] [TRT] Tactic: 2 time 0.367128
[08/16/2021-04:56:14] [V] [TRT] Tactic: 6 time 0.180508
[08/16/2021-04:56:14] [V] [TRT] Fastest Tactic: 6 Time: 0.180508
[08/16/2021-04:56:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (CudaDepthwiseConvolution)
[08/16/2021-04:56:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6680916730816870145
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] 
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:14] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,65536) -> Float(1,16,256,139776) ***************
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:56:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:56:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (FusedConvActConvolution)
[08/16/2021-04:56:15] [V] [TRT] Tactic: 524287 time 1.36801
[08/16/2021-04:56:15] [V] [TRT] Tactic: 720895 time 1.41022
[08/16/2021-04:56:15] [V] [TRT] Tactic: 983039 time 1.31646
[08/16/2021-04:56:15] [V] [TRT] Tactic: 1048575 time 1.26232
[08/16/2021-04:56:15] [V] [TRT] Tactic: 1703935 time 1.18738
[08/16/2021-04:56:15] [V] [TRT] Tactic: 1769471 time 1.83481
[08/16/2021-04:56:15] [V] [TRT] Tactic: 1966079 time 0.93362
[08/16/2021-04:56:15] [V] [TRT] Tactic: 2031615 time 1.54084
[08/16/2021-04:56:15] [V] [TRT] Tactic: 2228223 time 1.15325
[08/16/2021-04:56:15] [V] [TRT] Tactic: 2424831 time 1.05772
[08/16/2021-04:56:15] [V] [TRT] Tactic: 2621439 time 1.24702
[08/16/2021-04:56:15] [V] [TRT] Tactic: 2752511 time 1.59907
[08/16/2021-04:56:16] [V] [TRT] Tactic: 3014655 time 1.25174
[08/16/2021-04:56:16] [V] [TRT] Tactic: 3145727 time 1.49614
[08/16/2021-04:56:16] [V] [TRT] Tactic: 3604479 time 1.26474
[08/16/2021-04:56:16] [V] [TRT] Tactic: 4390911 time 1.66619
[08/16/2021-04:56:16] [V] [TRT] Tactic: 5046271 time 1.50413
[08/16/2021-04:56:16] [V] [TRT] Tactic: 5963775 time 1.4735
[08/16/2021-04:56:16] [V] [TRT] Tactic: 6160383 time 1.31867
[08/16/2021-04:56:16] [V] [TRT] Tactic: 6488063 time 1.66926
[08/16/2021-04:56:16] [V] [TRT] Tactic: 6881279 time 1.50781
[08/16/2021-04:56:16] [V] [TRT] Tactic: 7274495 time 1.93726
[08/16/2021-04:56:16] [V] [TRT] Tactic: 7864319 time 1.40163
[08/16/2021-04:56:16] [V] [TRT] Tactic: 7995391 time 0.991808
[08/16/2021-04:56:17] [V] [TRT] Tactic: 8585215 time 1.57487
[08/16/2021-04:56:17] [V] [TRT] Tactic: 8847359 time 1.96559
[08/16/2021-04:56:17] [V] [TRT] Tactic: 8978431 time 1.47411
[08/16/2021-04:56:17] [V] [TRT] Tactic: 9043967 time 1.5748
[08/16/2021-04:56:17] [V] [TRT] Tactic: 9175039 time 1.26759
[08/16/2021-04:56:17] [V] [TRT] Tactic: 9502719 time 1.77004
[08/16/2021-04:56:17] [V] [TRT] Tactic: 9961471 time 1.38743
[08/16/2021-04:56:17] [V] [TRT] Tactic: 10027007 time 1.50096
[08/16/2021-04:56:17] [V] [TRT] Tactic: 10092543 time 1.6629
[08/16/2021-04:56:17] [V] [TRT] Tactic: 10289151 time 0.93458
[08/16/2021-04:56:17] [V] [TRT] Tactic: 10485759 time 1.6314
[08/16/2021-04:56:18] [V] [TRT] Tactic: 10682367 time 1.1893
[08/16/2021-04:56:18] [V] [TRT] Tactic: 10813439 time 0.913444
[08/16/2021-04:56:18] [V] [TRT] Fastest Tactic: 10813439 Time: 0.913444
[08/16/2021-04:56:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CaskConvolution)
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:56:18] [V] [TRT] Tactic: 1825138533642645384 time 1.0953
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:18] [V] [TRT] Tactic: 2775507031594384867 time 0.455352
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:56:18] [V] [TRT] Tactic: 2842488832350522458 time 0.840928
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:56:18] [V] [TRT] Tactic: 3915320020053085238 time 1.08841
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:56:18] [V] [TRT] Tactic: 6448355332020552203 time 1.14758
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:56:18] [V] [TRT] Tactic: 6808617066150061604 time 0.85352
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:56:18] [V] [TRT] Tactic: -8060443123034038864 time 0.87212
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:56:18] [V] [TRT] Tactic: -4420849921117327522 time 1.14812
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:56:18] [V] [TRT] Tactic: -3946921629105938337 time 1.16148
[08/16/2021-04:56:18] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.455352
[08/16/2021-04:56:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CudaConvolution)
[08/16/2021-04:56:18] [V] [TRT] Tactic: 0 time 1.30453
[08/16/2021-04:56:18] [V] [TRT] Tactic: 2 time 1.21274
[08/16/2021-04:56:18] [V] [TRT] Tactic: 5 skipped. Scratch requested: 611795456, available: 16777216
[08/16/2021-04:56:18] [V] [TRT] Tactic: 6 time 0.845244
[08/16/2021-04:56:18] [V] [TRT] Tactic: 57 time 1.66257
[08/16/2021-04:56:18] [V] [TRT] Fastest Tactic: 6 Time: 0.845244
[08/16/2021-04:56:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CudaDepthwiseConvolution)
[08/16/2021-04:56:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:18] [V] [TRT] 
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:18] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,65536) -> Half(1,16,256,139776) ***************
[08/16/2021-04:56:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (FusedConvActConvolution)
[08/16/2021-04:56:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CaskConvolution)
[08/16/2021-04:56:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CudaConvolution)
[08/16/2021-04:56:18] [V] [TRT] Tactic: 0 time 1.49496
[08/16/2021-04:56:18] [V] [TRT] Tactic: 1 time 2.9676
[08/16/2021-04:56:18] [V] [TRT] Tactic: 2 time 1.28667
[08/16/2021-04:56:18] [V] [TRT] Tactic: 4 skipped. Scratch requested: 1223870464, available: 16777216
[08/16/2021-04:56:18] [V] [TRT] Tactic: 5 skipped. Scratch requested: 611795456, available: 16777216
[08/16/2021-04:56:18] [V] [TRT] Tactic: 6 skipped. Scratch requested: 20324864, available: 16777216
[08/16/2021-04:56:18] [V] [TRT] Fastest Tactic: 2 Time: 1.28667
[08/16/2021-04:56:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CudaDepthwiseConvolution)
[08/16/2021-04:56:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2
[08/16/2021-04:56:18] [V] [TRT] 
[08/16/2021-04:56:18] [V] [TRT] *************** Autotuning format combination: Half(1,16,256:2,32768) -> Half(1,16,256:2,69888) ***************
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (FusedConvActConvolution)
[08/16/2021-04:56:18] [V] [TRT] Tactic: 524287 time 0.675836
[08/16/2021-04:56:18] [V] [TRT] Tactic: 720895 time 0.75788
[08/16/2021-04:56:18] [V] [TRT] Tactic: 983039 time 0.691824
[08/16/2021-04:56:18] [V] [TRT] Tactic: 1048575 time 0.624096
[08/16/2021-04:56:18] [V] [TRT] Tactic: 1703935 time 0.584496
[08/16/2021-04:56:18] [V] [TRT] Tactic: 1769471 time 0.939668
[08/16/2021-04:56:19] [V] [TRT] Tactic: 1966079 time 0.470092
[08/16/2021-04:56:19] [V] [TRT] Tactic: 2031615 time 0.75498
[08/16/2021-04:56:19] [V] [TRT] Tactic: 2228223 time 0.580572
[08/16/2021-04:56:19] [V] [TRT] Tactic: 2424831 time 0.543528
[08/16/2021-04:56:19] [V] [TRT] Tactic: 2621439 time 0.639432
[08/16/2021-04:56:19] [V] [TRT] Tactic: 2752511 time 0.863336
[08/16/2021-04:56:19] [V] [TRT] Tactic: 3014655 time 0.602136
[08/16/2021-04:56:19] [V] [TRT] Tactic: 3145727 time 0.774244
[08/16/2021-04:56:19] [V] [TRT] Tactic: 3604479 time 0.60448
[08/16/2021-04:56:19] [V] [TRT] Tactic: 4390911 time 0.834152
[08/16/2021-04:56:19] [V] [TRT] Tactic: 5046271 time 0.825956
[08/16/2021-04:56:19] [V] [TRT] Tactic: 5963775 time 0.696504
[08/16/2021-04:56:19] [V] [TRT] Tactic: 6160383 time 0.655996
[08/16/2021-04:56:19] [V] [TRT] Tactic: 6488063 time 0.865932
[08/16/2021-04:56:19] [V] [TRT] Tactic: 6881279 time 0.711348
[08/16/2021-04:56:19] [V] [TRT] Tactic: 7274495 time 0.88162
[08/16/2021-04:56:19] [V] [TRT] Tactic: 7864319 time 0.7498
[08/16/2021-04:56:19] [V] [TRT] Tactic: 7995391 time 0.589192
[08/16/2021-04:56:19] [V] [TRT] Tactic: 8585215 time 0.79394
[08/16/2021-04:56:20] [V] [TRT] Tactic: 8847359 time 1.04178
[08/16/2021-04:56:20] [V] [TRT] Tactic: 8978431 time 0.699624
[08/16/2021-04:56:20] [V] [TRT] Tactic: 9043967 time 0.800116
[08/16/2021-04:56:20] [V] [TRT] Tactic: 9175039 time 0.60352
[08/16/2021-04:56:20] [V] [TRT] Tactic: 9502719 time 0.830004
[08/16/2021-04:56:20] [V] [TRT] Tactic: 9961471 time 0.716964
[08/16/2021-04:56:20] [V] [TRT] Tactic: 10027007 time 0.805204
[08/16/2021-04:56:20] [V] [TRT] Tactic: 10092543 time 0.835064
[08/16/2021-04:56:20] [V] [TRT] Tactic: 10289151 time 0.470972
[08/16/2021-04:56:20] [V] [TRT] Tactic: 10485759 time 0.783756
[08/16/2021-04:56:20] [V] [TRT] Tactic: 10682367 time 0.634632
[08/16/2021-04:56:20] [V] [TRT] Tactic: 10813439 time 0.487448
[08/16/2021-04:56:20] [V] [TRT] Fastest Tactic: 1966079 Time: 0.470092
[08/16/2021-04:56:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CaskConvolution)
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:20] [V] [TRT] Tactic: 1145226902788474763 time 0.453456
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:20] [V] [TRT] Tactic: 2418518597804310654 time 0.450768
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:20] [V] [TRT] Tactic: 8292881859266835088 time 0.707352
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:20] [V] [TRT] Tactic: 8401509141903434922 time 0.435028
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:20] [V] [TRT] Tactic: -8654297089785671176 time 0.566612
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:20] [V] [TRT] Tactic: -7448936905981214224 time 0.773772
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:20] [V] [TRT] Tactic: -3689982367035295496 time 0.583764
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:20] [V] [TRT] Tactic: -3140347171730126532 time 0.234676
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:20] [V] [TRT] Tactic: -2027588946874785071 time 0.719144
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:20] [V] [TRT] Tactic: -245090590808296743 time 0.592484
[08/16/2021-04:56:20] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.234676
[08/16/2021-04:56:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CudaConvolution)
[08/16/2021-04:56:20] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CudaDepthwiseConvolution)
[08/16/2021-04:56:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:20] [V] [TRT] 
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:20] [V] [TRT] *************** Autotuning format combination: Half(32,512,1:8,8192) -> Float(1,16,256,139776) ***************
[08/16/2021-04:56:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (FusedConvActConvolution)
[08/16/2021-04:56:20] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CaskConvolution)
[08/16/2021-04:56:20] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CudaConvolution)
[08/16/2021-04:56:20] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CudaDepthwiseConvolution)
[08/16/2021-04:56:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:20] [V] [TRT] *************** Autotuning format combination: Half(32,512,1:8,8192) -> Half(69,1104,1:8,17664) ***************
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (FusedConvActConvolution)
[08/16/2021-04:56:20] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CaskConvolution)
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] Tactic: 3754069740140581927 time 0.183456
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] Tactic: 5925270497649423688 time 0.166992
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] Tactic: 6680916730816870145 time 0.19014
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] Tactic: 7158029511300006471 time 0.182
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] Tactic: 7859952145590271433 time 0.191312
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] Tactic: 8283847742354150423 time 0.180392
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] Tactic: -4534876761957424274 time 0.165812
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] Tactic: -3237051169894153788 time 0.1804
[08/16/2021-04:56:20] [V] [TRT] Fastest Tactic: -4534876761957424274 Time: 0.165812
[08/16/2021-04:56:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CudaConvolution)
[08/16/2021-04:56:20] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CudaDepthwiseConvolution)
[08/16/2021-04:56:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4534876761957424274
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] 
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:20] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:56:20] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:56:20] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:56:20] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:56:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_1/Relu6 (FusedConvActConvolution)
[08/16/2021-04:56:20] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_1/Relu6 (CaskConvolution)
[08/16/2021-04:56:20] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_1/Relu6 (CudaConvolution)
[08/16/2021-04:56:20] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_1/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:56:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:20] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576) -> Half(1,64,4096,1048576) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288) -> Half(1,64,4096:2,524288) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Float(1,64,4096,1048576) ***************
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_1/Relu6 (FusedConvActConvolution)
[08/16/2021-04:56:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_1/Relu6 (CaskConvolution)
[08/16/2021-04:56:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_1/Relu6 (CudaConvolution)
[08/16/2021-04:56:21] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_1/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:56:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Half(32,2048,1:8,131072) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,4194304) -> Float(1,128,16384,4194304) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,4194304) -> Half(1,128,16384,4194304) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,2097152) -> Half(1,128,16384:2,2097152) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Half(32,4096,1:8,524288) -> Float(1,128,16384,4194304) ***************
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_0/Relu6 (FusedConvActConvolution)
[08/16/2021-04:56:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_0/Relu6 (CaskConvolution)
[08/16/2021-04:56:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_0/Relu6 (CudaConvolution)
[08/16/2021-04:56:21] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_0/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:56:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Half(32,4096,1:8,524288) -> Half(32,4096,1:8,524288) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,4194304) -> Float(1,128,16384,4194304) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,4194304) -> Half(1,128,16384,4194304) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,2097152) -> Half(1,128,16384:2,2097152) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Half(32,4096,1:8,524288) -> Float(1,128,16384,4194304) ***************
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_0/Relu6 (FusedConvActConvolution)
[08/16/2021-04:56:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_0/Relu6 (CaskConvolution)
[08/16/2021-04:56:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_0/Relu6 (CudaConvolution)
[08/16/2021-04:56:21] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_0/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:56:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Half(32,4096,1:8,524288) -> Half(32,4096,1:8,524288) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,4194304) -> Float(1,128,16384,4194304) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,4194304) -> Half(1,128,16384,4194304) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,2097152) -> Half(1,128,16384:2,2097152) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Half(32,4096,1:8,524288) -> Float(1,128,16384,4194304) ***************
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_0/Relu6 (FusedConvActConvolution)
[08/16/2021-04:56:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_0/Relu6 (CaskConvolution)
[08/16/2021-04:56:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_0/Relu6 (CudaConvolution)
[08/16/2021-04:56:21] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_0/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:56:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Half(32,4096,1:8,524288) -> Half(32,4096,1:8,524288) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,4194304) -> Float(1,128,16384,4194304) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,4194304) -> Half(1,128,16384,4194304) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,2097152) -> Half(1,128,16384:2,2097152) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Half(32,4096,1:8,524288) -> Float(1,128,16384,4194304) ***************
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_0/Relu6 (FusedConvActConvolution)
[08/16/2021-04:56:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_0/Relu6 (CaskConvolution)
[08/16/2021-04:56:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_0/Relu6 (CudaConvolution)
[08/16/2021-04:56:21] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_0/Relu6 (CudaDepthwiseConvolution)
[08/16/2021-04:56:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Half(32,4096,1:8,524288) -> Half(32,4096,1:8,524288) ***************
[08/16/2021-04:56:21] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,98304) ***************
[08/16/2021-04:56:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:56:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:56:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:56:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:56:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:56:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:56:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:56:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:56:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (FusedConvActConvolution)
[08/16/2021-04:56:21] [V] [TRT] Tactic: 524287 time 0.925288
[08/16/2021-04:56:21] [V] [TRT] Tactic: 720895 time 1.59889
[08/16/2021-04:56:21] [V] [TRT] Tactic: 983039 time 1.71233
[08/16/2021-04:56:21] [V] [TRT] Tactic: 1048575 time 0.850564
[08/16/2021-04:56:21] [V] [TRT] Tactic: 1703935 time 0.840772
[08/16/2021-04:56:21] [V] [TRT] Tactic: 1769471 time 1.91726
[08/16/2021-04:56:21] [V] [TRT] Tactic: 1966079 time 1.74182
[08/16/2021-04:56:21] [V] [TRT] Tactic: 2031615 time 1.7907
[08/16/2021-04:56:21] [V] [TRT] Tactic: 2228223 time 0.904988
[08/16/2021-04:56:22] [V] [TRT] Tactic: 2424831 time 0.860432
[08/16/2021-04:56:22] [V] [TRT] Tactic: 2621439 time 0.895056
[08/16/2021-04:56:22] [V] [TRT] Tactic: 2752511 time 1.85854
[08/16/2021-04:56:22] [V] [TRT] Tactic: 2818047 time 3.54562
[08/16/2021-04:56:22] [V] [TRT] Tactic: 2883583 time 3.14039
[08/16/2021-04:56:22] [V] [TRT] Tactic: 3014655 time 0.922668
[08/16/2021-04:56:22] [V] [TRT] Tactic: 3145727 time 1.70651
[08/16/2021-04:56:22] [V] [TRT] Tactic: 3473407 time 3.43212
[08/16/2021-04:56:22] [V] [TRT] Tactic: 3604479 time 0.918208
[08/16/2021-04:56:22] [V] [TRT] Tactic: 3735551 time 3.19321
[08/16/2021-04:56:23] [V] [TRT] Tactic: 4390911 time 1.87934
[08/16/2021-04:56:23] [V] [TRT] Tactic: 5046271 time 0.926428
[08/16/2021-04:56:23] [V] [TRT] Tactic: 5963775 time 1.79356
[08/16/2021-04:56:23] [V] [TRT] Tactic: 6160383 time 1.02769
[08/16/2021-04:56:23] [V] [TRT] Tactic: 6488063 time 1.07709
[08/16/2021-04:56:23] [V] [TRT] Tactic: 6881279 time 1.88528
[08/16/2021-04:56:23] [V] [TRT] Tactic: 7274495 time 1.84944
[08/16/2021-04:56:23] [V] [TRT] Tactic: 7864319 time 0.969832
[08/16/2021-04:56:23] [V] [TRT] Tactic: 7995391 time 1.60108
[08/16/2021-04:56:23] [V] [TRT] Tactic: 8585215 time 0.971864
[08/16/2021-04:56:23] [V] [TRT] Tactic: 8847359 time 1.16268
[08/16/2021-04:56:23] [V] [TRT] Tactic: 8978431 time 1.76743
[08/16/2021-04:56:23] [V] [TRT] Tactic: 9043967 time 1.01428
[08/16/2021-04:56:23] [V] [TRT] Tactic: 9175039 time 0.91798
[08/16/2021-04:56:24] [V] [TRT] Tactic: 9502719 time 1.89531
[08/16/2021-04:56:24] [V] [TRT] Tactic: 9830399 time 3.38251
[08/16/2021-04:56:24] [V] [TRT] Tactic: 9961471 time 1.05008
[08/16/2021-04:56:24] [V] [TRT] Tactic: 10027007 time 0.9437
[08/16/2021-04:56:24] [V] [TRT] Tactic: 10092543 time 1.8833
[08/16/2021-04:56:24] [V] [TRT] Tactic: 10289151 time 1.74615
[08/16/2021-04:56:24] [V] [TRT] Tactic: 10485759 time 0.890248
[08/16/2021-04:56:24] [V] [TRT] Tactic: 10682367 time 0.8644
[08/16/2021-04:56:24] [V] [TRT] Tactic: 10813439 time 1.56091
[08/16/2021-04:56:24] [V] [TRT] Fastest Tactic: 1703935 Time: 0.840772
[08/16/2021-04:56:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (CaskConvolution)
[08/16/2021-04:56:24] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:56:24] [V] [TRT] Tactic: 1825138533642645384 time 3.25346
[08/16/2021-04:56:24] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:24] [V] [TRT] Tactic: 2775507031594384867 time 0.433948
[08/16/2021-04:56:24] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:56:24] [V] [TRT] Tactic: 2842488832350522458 time 1.64754
[08/16/2021-04:56:24] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:56:24] [V] [TRT] Tactic: 3915320020053085238 time 3.2375
[08/16/2021-04:56:24] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:56:24] [V] [TRT] Tactic: 6448355332020552203 time 3.32168
[08/16/2021-04:56:24] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:56:24] [V] [TRT] Tactic: 6808617066150061604 time 1.67508
[08/16/2021-04:56:24] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:56:24] [V] [TRT] Tactic: -8060443123034038864 time 1.6963
[08/16/2021-04:56:24] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:56:25] [V] [TRT] Tactic: -4420849921117327522 time 1.0793
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:56:25] [V] [TRT] Tactic: -3946921629105938337 time 1.1618
[08/16/2021-04:56:25] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.433948
[08/16/2021-04:56:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (CudaConvolution)
[08/16/2021-04:56:25] [V] [TRT] Tactic: 0 time 1.20076
[08/16/2021-04:56:25] [V] [TRT] Tactic: 2 skipped. Scratch requested: 37748736, available: 16777216
[08/16/2021-04:56:25] [V] [TRT] Tactic: 5 skipped. Scratch requested: 29175808, available: 16777216
[08/16/2021-04:56:25] [V] [TRT] Tactic: 6 time 0.474248
[08/16/2021-04:56:25] [V] [TRT] Tactic: 57 time 1.6643
[08/16/2021-04:56:25] [V] [TRT] Fastest Tactic: 6 Time: 0.474248
[08/16/2021-04:56:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (CudaDepthwiseConvolution)
[08/16/2021-04:56:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:25] [V] [TRT] 
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:25] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576) -> Half(1,64,4096,98304) ***************
[08/16/2021-04:56:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (FusedConvActConvolution)
[08/16/2021-04:56:25] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (CaskConvolution)
[08/16/2021-04:56:25] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (CudaConvolution)
[08/16/2021-04:56:25] [V] [TRT] Tactic: 0 time 1.41584
[08/16/2021-04:56:25] [V] [TRT] Tactic: 1 time 1.86494
[08/16/2021-04:56:25] [V] [TRT] Tactic: 2 skipped. Scratch requested: 18874368, available: 16777216
[08/16/2021-04:56:25] [V] [TRT] Tactic: 4 skipped. Scratch requested: 852189184, available: 16777216
[08/16/2021-04:56:25] [V] [TRT] Tactic: 5 skipped. Scratch requested: 29175808, available: 16777216
[08/16/2021-04:56:25] [V] [TRT] Tactic: 6 time 0.753596
[08/16/2021-04:56:25] [V] [TRT] Fastest Tactic: 6 Time: 0.753596
[08/16/2021-04:56:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (CudaDepthwiseConvolution)
[08/16/2021-04:56:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6
[08/16/2021-04:56:25] [V] [TRT] 
[08/16/2021-04:56:25] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288) -> Half(1,64,4096:2,49152) ***************
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:25] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (FusedConvActConvolution)
[08/16/2021-04:56:25] [V] [TRT] Tactic: 524287 time 0.468328
[08/16/2021-04:56:25] [V] [TRT] Tactic: 720895 time 0.942416
[08/16/2021-04:56:25] [V] [TRT] Tactic: 983039 time 0.875356
[08/16/2021-04:56:25] [V] [TRT] Tactic: 1048575 time 0.45096
[08/16/2021-04:56:25] [V] [TRT] Tactic: 1703935 time 0.435152
[08/16/2021-04:56:25] [V] [TRT] Tactic: 1769471 time 0.994576
[08/16/2021-04:56:25] [V] [TRT] Tactic: 1966079 time 0.870912
[08/16/2021-04:56:25] [V] [TRT] Tactic: 2031615 time 0.897388
[08/16/2021-04:56:25] [V] [TRT] Tactic: 2228223 time 0.459488
[08/16/2021-04:56:25] [V] [TRT] Tactic: 2424831 time 0.441328
[08/16/2021-04:56:25] [V] [TRT] Tactic: 2621439 time 0.456316
[08/16/2021-04:56:25] [V] [TRT] Tactic: 2752511 time 1.01903
[08/16/2021-04:56:25] [V] [TRT] Tactic: 2818047 time 1.7868
[08/16/2021-04:56:25] [V] [TRT] Tactic: 2883583 time 1.58712
[08/16/2021-04:56:25] [V] [TRT] Tactic: 3014655 time 0.457084
[08/16/2021-04:56:26] [V] [TRT] Tactic: 3145727 time 0.871632
[08/16/2021-04:56:26] [V] [TRT] Tactic: 3473407 time 1.70155
[08/16/2021-04:56:26] [V] [TRT] Tactic: 3604479 time 0.456516
[08/16/2021-04:56:26] [V] [TRT] Tactic: 3735551 time 1.59191
[08/16/2021-04:56:26] [V] [TRT] Tactic: 4390911 time 0.9382
[08/16/2021-04:56:26] [V] [TRT] Tactic: 5046271 time 0.489216
[08/16/2021-04:56:26] [V] [TRT] Tactic: 5963775 time 0.96408
[08/16/2021-04:56:26] [V] [TRT] Tactic: 6160383 time 0.487528
[08/16/2021-04:56:26] [V] [TRT] Tactic: 6488063 time 0.554112
[08/16/2021-04:56:26] [V] [TRT] Tactic: 6881279 time 0.9745
[08/16/2021-04:56:26] [V] [TRT] Tactic: 7274495 time 0.910532
[08/16/2021-04:56:26] [V] [TRT] Tactic: 7864319 time 0.506212
[08/16/2021-04:56:26] [V] [TRT] Tactic: 7995391 time 0.979344
[08/16/2021-04:56:26] [V] [TRT] Tactic: 8585215 time 0.495904
[08/16/2021-04:56:26] [V] [TRT] Tactic: 8847359 time 0.6016
[08/16/2021-04:56:26] [V] [TRT] Tactic: 8978431 time 0.954528
[08/16/2021-04:56:26] [V] [TRT] Tactic: 9043967 time 0.49082
[08/16/2021-04:56:26] [V] [TRT] Tactic: 9175039 time 0.456488
[08/16/2021-04:56:26] [V] [TRT] Tactic: 9502719 time 0.9427
[08/16/2021-04:56:26] [V] [TRT] Tactic: 9830399 time 1.72866
[08/16/2021-04:56:26] [V] [TRT] Tactic: 9961471 time 0.521424
[08/16/2021-04:56:27] [V] [TRT] Tactic: 10027007 time 0.499228
[08/16/2021-04:56:27] [V] [TRT] Tactic: 10092543 time 0.941292
[08/16/2021-04:56:27] [V] [TRT] Tactic: 10289151 time 0.87108
[08/16/2021-04:56:27] [V] [TRT] Tactic: 10485759 time 0.456524
[08/16/2021-04:56:27] [V] [TRT] Tactic: 10682367 time 0.450468
[08/16/2021-04:56:27] [V] [TRT] Tactic: 10813439 time 0.80462
[08/16/2021-04:56:27] [V] [TRT] Fastest Tactic: 1703935 Time: 0.435152
[08/16/2021-04:56:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (CaskConvolution)
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:27] [V] [TRT] Tactic: 1145226902788474763 time 0.86984
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:27] [V] [TRT] Tactic: 2418518597804310654 time 0.870388
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:27] [V] [TRT] Tactic: 8292881859266835088 time 0.450784
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:27] [V] [TRT] Tactic: 8401509141903434922 time 0.853856
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:27] [V] [TRT] Tactic: -8654297089785671176 time 1.68189
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:27] [V] [TRT] Tactic: -7448936905981214224 time 0.460268
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:27] [V] [TRT] Tactic: -3689982367035295496 time 1.6863
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:27] [V] [TRT] Tactic: -3140347171730126532 time 0.225664
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:27] [V] [TRT] Tactic: -2027588946874785071 time 0.446576
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:27] [V] [TRT] Tactic: -245090590808296743 time 1.71708
[08/16/2021-04:56:27] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.225664
[08/16/2021-04:56:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (CudaConvolution)
[08/16/2021-04:56:27] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (CudaDepthwiseConvolution)
[08/16/2021-04:56:27] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:27] [V] [TRT] 
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:27] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Float(1,64,4096,98304) ***************
[08/16/2021-04:56:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (FusedConvActConvolution)
[08/16/2021-04:56:27] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (CaskConvolution)
[08/16/2021-04:56:27] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (CudaConvolution)
[08/16/2021-04:56:27] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (CudaDepthwiseConvolution)
[08/16/2021-04:56:27] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:27] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Half(3,192,1:8,12288) ***************
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (FusedConvActConvolution)
[08/16/2021-04:56:27] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (CaskConvolution)
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:27] [V] [TRT] Tactic: 3754069740140581927 time 0.481736
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:27] [V] [TRT] Tactic: 5925270497649423688 time 0.457268
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:27] [V] [TRT] Tactic: 6680916730816870145 time 0.286844
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:27] [V] [TRT] Tactic: 7158029511300006471 time 0.308028
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:27] [V] [TRT] Tactic: 7859952145590271433 time 0.290064
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:27] [V] [TRT] Tactic: 8283847742354150423 time 0.477812
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:27] [V] [TRT] Tactic: -4534876761957424274 time 0.45596
[08/16/2021-04:56:27] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:27] [V] [TRT] Tactic: -3237051169894153788 time 0.29178
[08/16/2021-04:56:27] [V] [TRT] Fastest Tactic: 6680916730816870145 Time: 0.286844
[08/16/2021-04:56:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (CudaConvolution)
[08/16/2021-04:56:28] [V] [TRT] Tactic: 0 time 43.0591
[08/16/2021-04:56:28] [V] [TRT] Tactic: 1 time 2.18264
[08/16/2021-04:56:28] [V] [TRT] Tactic: 2 skipped. Scratch requested: 19071488, available: 16777216
[08/16/2021-04:56:28] [V] [TRT] Tactic: 6 time 0.683736
[08/16/2021-04:56:28] [V] [TRT] Fastest Tactic: 6 Time: 0.683736
[08/16/2021-04:56:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (CudaDepthwiseConvolution)
[08/16/2021-04:56:28] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6680916730816870145
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:28] [V] [TRT] 
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:28] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,2236416) ***************
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:56:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (FusedConvActConvolution)
[08/16/2021-04:56:28] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CaskConvolution)
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:56:28] [V] [TRT] Tactic: 1825138533642645384 time 14.8741
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:28] [V] [TRT] Tactic: 2775507031594384867 time 8.01769
[08/16/2021-04:56:28] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:56:29] [V] [TRT] Tactic: 2842488832350522458 time 15.9265
[08/16/2021-04:56:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:56:29] [V] [TRT] Tactic: 3915320020053085238 time 14.8216
[08/16/2021-04:56:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:56:29] [V] [TRT] Tactic: 6448355332020552203 time 14.9755
[08/16/2021-04:56:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:56:29] [V] [TRT] Tactic: 6808617066150061604 time 13.3533
[08/16/2021-04:56:29] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:56:30] [V] [TRT] Tactic: -8060443123034038864 time 13.4515
[08/16/2021-04:56:30] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:56:30] [V] [TRT] Tactic: -4420849921117327522 time 14.948
[08/16/2021-04:56:30] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:56:30] [V] [TRT] Tactic: -3946921629105938337 time 14.4192
[08/16/2021-04:56:30] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 8.01769
[08/16/2021-04:56:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CudaConvolution)
[08/16/2021-04:56:30] [V] [TRT] Tactic: 0 time 20.3978
[08/16/2021-04:56:30] [V] [TRT] Tactic: 2 skipped. Scratch requested: 37748736, available: 16777216
[08/16/2021-04:56:30] [V] [TRT] Tactic: 5 skipped. Scratch requested: 615285760, available: 16777216
[08/16/2021-04:56:31] [V] [TRT] Tactic: 6 time 8.50987
[08/16/2021-04:56:31] [V] [TRT] Tactic: 57 time 19.3714
[08/16/2021-04:56:31] [V] [TRT] Fastest Tactic: 6 Time: 8.50987
[08/16/2021-04:56:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CudaDepthwiseConvolution)
[08/16/2021-04:56:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867
[08/16/2021-04:56:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:31] [V] [TRT] 
[08/16/2021-04:56:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:56:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:56:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:56:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:56:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:56:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:56:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:56:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:56:31] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:31] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,1048576) -> Half(1,64,4096,2236416) ***************
[08/16/2021-04:56:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (FusedConvActConvolution)
[08/16/2021-04:56:31] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CaskConvolution)
[08/16/2021-04:56:31] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CudaConvolution)
[08/16/2021-04:56:31] [V] [TRT] Tactic: 0 time 21.2214
[08/16/2021-04:56:31] [V] [TRT] Tactic: 1 time 15.6654
[08/16/2021-04:56:31] [V] [TRT] Tactic: 2 skipped. Scratch requested: 18874368, available: 16777216
[08/16/2021-04:56:31] [V] [TRT] Tactic: 4 skipped. Scratch requested: 18646091776, available: 16777216
[08/16/2021-04:56:31] [V] [TRT] Tactic: 5 skipped. Scratch requested: 615285760, available: 16777216
[08/16/2021-04:56:31] [V] [TRT] Tactic: 6 skipped. Scratch requested: 32643584, available: 16777216
[08/16/2021-04:56:31] [V] [TRT] Fastest Tactic: 1 Time: 15.6654
[08/16/2021-04:56:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CudaDepthwiseConvolution)
[08/16/2021-04:56:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1
[08/16/2021-04:56:31] [V] [TRT] 
[08/16/2021-04:56:32] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096:2,524288) -> Half(1,64,4096:2,1118208) ***************
[08/16/2021-04:56:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (FusedConvActConvolution)
[08/16/2021-04:56:32] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CaskConvolution)
[08/16/2021-04:56:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:32] [V] [TRT] Tactic: 1145226902788474763 time 6.79356
[08/16/2021-04:56:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:32] [V] [TRT] Tactic: 2418518597804310654 time 6.82746
[08/16/2021-04:56:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:32] [V] [TRT] Tactic: 8292881859266835088 time 7.46615
[08/16/2021-04:56:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:32] [V] [TRT] Tactic: 8401509141903434922 time 6.73622
[08/16/2021-04:56:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:32] [V] [TRT] Tactic: -8654297089785671176 time 7.57246
[08/16/2021-04:56:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:32] [V] [TRT] Tactic: -7448936905981214224 time 7.84363
[08/16/2021-04:56:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:32] [V] [TRT] Tactic: -3689982367035295496 time 7.59396
[08/16/2021-04:56:32] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:33] [V] [TRT] Tactic: -3140347171730126532 time 3.79244
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:33] [V] [TRT] Tactic: -2027588946874785071 time 7.19822
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:33] [V] [TRT] Tactic: -245090590808296743 time 7.72366
[08/16/2021-04:56:33] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 3.79244
[08/16/2021-04:56:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CudaConvolution)
[08/16/2021-04:56:33] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CudaDepthwiseConvolution)
[08/16/2021-04:56:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:33] [V] [TRT] 
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:33] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Float(1,64,4096,2236416) ***************
[08/16/2021-04:56:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (FusedConvActConvolution)
[08/16/2021-04:56:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CaskConvolution)
[08/16/2021-04:56:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CudaConvolution)
[08/16/2021-04:56:33] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CudaDepthwiseConvolution)
[08/16/2021-04:56:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:33] [V] [TRT] *************** Autotuning format combination: Half(32,2048,1:8,131072) -> Half(69,4416,1:8,282624) ***************
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (FusedConvActConvolution)
[08/16/2021-04:56:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CaskConvolution)
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] Tactic: 3754069740140581927 time 2.32816
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] Tactic: 5925270497649423688 time 2.22771
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] Tactic: 6680916730816870145 time 2.26828
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] Tactic: 7158029511300006471 time 2.17039
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] Tactic: 7859952145590271433 time 2.27762
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] Tactic: 8283847742354150423 time 2.33606
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] Tactic: -4534876761957424274 time 2.30378
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] Tactic: -3237051169894153788 time 2.13431
[08/16/2021-04:56:33] [V] [TRT] Fastest Tactic: -3237051169894153788 Time: 2.13431
[08/16/2021-04:56:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CudaConvolution)
[08/16/2021-04:56:33] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CudaDepthwiseConvolution)
[08/16/2021-04:56:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3237051169894153788
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] 
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:33] [V] [TRT] *************** Autotuning format combination: Float(1,8,64,16384) -> Float(1,8,64,1536) ***************
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:56:33] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:56:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (FusedConvActConvolution)
[08/16/2021-04:56:33] [V] [TRT] Tactic: 524287 time 0.1968
[08/16/2021-04:56:33] [V] [TRT] Tactic: 720895 time 0.169284
[08/16/2021-04:56:33] [V] [TRT] Tactic: 983039 time 0.083904
[08/16/2021-04:56:33] [V] [TRT] Tactic: 1048575 time 0.130348
[08/16/2021-04:56:33] [V] [TRT] Tactic: 1703935 time 0.068772
[08/16/2021-04:56:33] [V] [TRT] Tactic: 1769471 time 0.087444
[08/16/2021-04:56:33] [V] [TRT] Tactic: 1966079 time 0.34354
[08/16/2021-04:56:33] [V] [TRT] Tactic: 2031615 time 0.284716
[08/16/2021-04:56:33] [V] [TRT] Tactic: 2228223 time 0.180784
[08/16/2021-04:56:33] [V] [TRT] Tactic: 2424831 time 0.064196
[08/16/2021-04:56:33] [V] [TRT] Tactic: 2621439 time 0.056336
[08/16/2021-04:56:33] [V] [TRT] Tactic: 2752511 time 0.190512
[08/16/2021-04:56:33] [V] [TRT] Tactic: 2818047 time 0.248168
[08/16/2021-04:56:34] [V] [TRT] Tactic: 2883583 time 0.44602
[08/16/2021-04:56:34] [V] [TRT] Tactic: 3014655 time 0.085952
[08/16/2021-04:56:34] [V] [TRT] Tactic: 3145727 time 0.09922
[08/16/2021-04:56:34] [V] [TRT] Tactic: 3473407 time 0.225928
[08/16/2021-04:56:34] [V] [TRT] Tactic: 3604479 time 0.086312
[08/16/2021-04:56:34] [V] [TRT] Tactic: 3735551 time 0.138336
[08/16/2021-04:56:34] [V] [TRT] Tactic: 4390911 time 0.371032
[08/16/2021-04:56:34] [V] [TRT] Tactic: 5046271 time 0.102848
[08/16/2021-04:56:34] [V] [TRT] Tactic: 5963775 time 0.31246
[08/16/2021-04:56:34] [V] [TRT] Tactic: 6160383 time 0.184968
[08/16/2021-04:56:34] [V] [TRT] Tactic: 6488063 time 0.149016
[08/16/2021-04:56:34] [V] [TRT] Tactic: 6881279 time 0.252812
[08/16/2021-04:56:34] [V] [TRT] Tactic: 7274495 time 0.054408
[08/16/2021-04:56:34] [V] [TRT] Tactic: 7864319 time 0.062188
[08/16/2021-04:56:34] [V] [TRT] Tactic: 7995391 time 0.176716
[08/16/2021-04:56:34] [V] [TRT] Tactic: 8585215 time 0.227328
[08/16/2021-04:56:34] [V] [TRT] Tactic: 8847359 time 0.066048
[08/16/2021-04:56:34] [V] [TRT] Tactic: 8978431 time 0.31262
[08/16/2021-04:56:34] [V] [TRT] Tactic: 9043967 time 0.078128
[08/16/2021-04:56:34] [V] [TRT] Tactic: 9175039 time 0.08586
[08/16/2021-04:56:34] [V] [TRT] Tactic: 9502719 time 0.370864
[08/16/2021-04:56:34] [V] [TRT] Tactic: 9830399 time 0.257084
[08/16/2021-04:56:34] [V] [TRT] Tactic: 9961471 time 0.073028
[08/16/2021-04:56:34] [V] [TRT] Tactic: 10027007 time 0.11676
[08/16/2021-04:56:34] [V] [TRT] Tactic: 10092543 time 0.370924
[08/16/2021-04:56:34] [V] [TRT] Tactic: 10289151 time 0.34352
[08/16/2021-04:56:34] [V] [TRT] Tactic: 10485759 time 0.062268
[08/16/2021-04:56:34] [V] [TRT] Tactic: 10682367 time 0.05648
[08/16/2021-04:56:34] [V] [TRT] Tactic: 10813439 time 0.092844
[08/16/2021-04:56:34] [V] [TRT] Fastest Tactic: 7274495 Time: 0.054408
[08/16/2021-04:56:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (CaskConvolution)
[08/16/2021-04:56:34] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:56:34] [V] [TRT] Tactic: 1825138533642645384 time 0.561624
[08/16/2021-04:56:34] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:34] [V] [TRT] Tactic: 2775507031594384867 time 0.080584
[08/16/2021-04:56:34] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:56:34] [V] [TRT] Tactic: 2842488832350522458 time 0.358804
[08/16/2021-04:56:34] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:56:34] [V] [TRT] Tactic: 3915320020053085238 time 0.550872
[08/16/2021-04:56:34] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:56:34] [V] [TRT] Tactic: 6448355332020552203 time 0.57258
[08/16/2021-04:56:34] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:56:34] [V] [TRT] Tactic: 6808617066150061604 time 0.314228
[08/16/2021-04:56:34] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:56:34] [V] [TRT] Tactic: -8060443123034038864 time 0.370344
[08/16/2021-04:56:34] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:56:34] [V] [TRT] Tactic: -4420849921117327522 time 0.295264
[08/16/2021-04:56:34] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:56:34] [V] [TRT] Tactic: -3946921629105938337 time 0.342128
[08/16/2021-04:56:34] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.080584
[08/16/2021-04:56:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (CudaConvolution)
[08/16/2021-04:56:34] [V] [TRT] Tactic: 0 time 0.151156
[08/16/2021-04:56:34] [V] [TRT] Tactic: 2 time 0.315292
[08/16/2021-04:56:34] [V] [TRT] Tactic: 5 skipped. Scratch requested: 27957248, available: 16777216
[08/16/2021-04:56:34] [V] [TRT] Tactic: 6 time 0.105068
[08/16/2021-04:56:34] [V] [TRT] Tactic: 57 time 0.624744
[08/16/2021-04:56:34] [V] [TRT] Fastest Tactic: 6 Time: 0.105068
[08/16/2021-04:56:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (CudaDepthwiseConvolution)
[08/16/2021-04:56:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7274495
[08/16/2021-04:56:34] [V] [TRT] 
[08/16/2021-04:56:34] [V] [TRT] *************** Autotuning format combination: Half(1,8,64,16384) -> Half(1,8,64,1536) ***************
[08/16/2021-04:56:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (FusedConvActConvolution)
[08/16/2021-04:56:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (CaskConvolution)
[08/16/2021-04:56:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (CudaConvolution)
[08/16/2021-04:56:34] [V] [TRT] Tactic: 0 time 0.183324
[08/16/2021-04:56:34] [V] [TRT] Tactic: 1 time 0.661752
[08/16/2021-04:56:34] [V] [TRT] Tactic: 2 time 0.181064
[08/16/2021-04:56:34] [V] [TRT] Tactic: 4 time 0.427564
[08/16/2021-04:56:34] [V] [TRT] Tactic: 5 skipped. Scratch requested: 27957248, available: 16777216
[08/16/2021-04:56:34] [V] [TRT] Tactic: 6 time 0.251288
[08/16/2021-04:56:34] [V] [TRT] Fastest Tactic: 2 Time: 0.181064
[08/16/2021-04:56:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (CudaDepthwiseConvolution)
[08/16/2021-04:56:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2
[08/16/2021-04:56:34] [V] [TRT] 
[08/16/2021-04:56:34] [V] [TRT] *************** Autotuning format combination: Half(1,8,64:2,8192) -> Half(1,8,64:2,768) ***************
[08/16/2021-04:56:34] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:34] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:34] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:34] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:34] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:34] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:34] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:34] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:34] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:34] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (FusedConvActConvolution)
[08/16/2021-04:56:34] [V] [TRT] Tactic: 524287 time 0.102212
[08/16/2021-04:56:34] [V] [TRT] Tactic: 720895 time 0.090084
[08/16/2021-04:56:34] [V] [TRT] Tactic: 983039 time 0.04676
[08/16/2021-04:56:34] [V] [TRT] Tactic: 1048575 time 0.069684
[08/16/2021-04:56:34] [V] [TRT] Tactic: 1703935 time 0.03884
[08/16/2021-04:56:34] [V] [TRT] Tactic: 1769471 time 0.047196
[08/16/2021-04:56:34] [V] [TRT] Tactic: 1966079 time 0.179652
[08/16/2021-04:56:34] [V] [TRT] Tactic: 2031615 time 0.149428
[08/16/2021-04:56:34] [V] [TRT] Tactic: 2228223 time 0.095052
[08/16/2021-04:56:34] [V] [TRT] Tactic: 2424831 time 0.036816
[08/16/2021-04:56:34] [V] [TRT] Tactic: 2621439 time 0.031048
[08/16/2021-04:56:35] [V] [TRT] Tactic: 2752511 time 0.100924
[08/16/2021-04:56:35] [V] [TRT] Tactic: 2818047 time 0.128252
[08/16/2021-04:56:35] [V] [TRT] Tactic: 2883583 time 0.2252
[08/16/2021-04:56:35] [V] [TRT] Tactic: 3014655 time 0.048696
[08/16/2021-04:56:35] [V] [TRT] Tactic: 3145727 time 0.054408
[08/16/2021-04:56:35] [V] [TRT] Tactic: 3473407 time 0.116536
[08/16/2021-04:56:35] [V] [TRT] Tactic: 3604479 time 0.0485
[08/16/2021-04:56:35] [V] [TRT] Tactic: 3735551 time 0.06778
[08/16/2021-04:56:35] [V] [TRT] Tactic: 4390911 time 0.194344
[08/16/2021-04:56:35] [V] [TRT] Tactic: 5046271 time 0.057852
[08/16/2021-04:56:35] [V] [TRT] Tactic: 5963775 time 0.162112
[08/16/2021-04:56:35] [V] [TRT] Tactic: 6160383 time 0.096852
[08/16/2021-04:56:35] [V] [TRT] Tactic: 6488063 time 0.079724
[08/16/2021-04:56:35] [V] [TRT] Tactic: 6881279 time 0.132028
[08/16/2021-04:56:35] [V] [TRT] Tactic: 7274495 time 0.03146
[08/16/2021-04:56:35] [V] [TRT] Tactic: 7864319 time 0.033012
[08/16/2021-04:56:35] [V] [TRT] Tactic: 7995391 time 0.094916
[08/16/2021-04:56:35] [V] [TRT] Tactic: 8585215 time 0.118468
[08/16/2021-04:56:35] [V] [TRT] Tactic: 8847359 time 0.036552
[08/16/2021-04:56:35] [V] [TRT] Tactic: 8978431 time 0.162468
[08/16/2021-04:56:35] [V] [TRT] Tactic: 9043967 time 0.044768
[08/16/2021-04:56:35] [V] [TRT] Tactic: 9175039 time 0.04836
[08/16/2021-04:56:35] [V] [TRT] Tactic: 9502719 time 0.1925
[08/16/2021-04:56:35] [V] [TRT] Tactic: 9830399 time 0.133556
[08/16/2021-04:56:35] [V] [TRT] Tactic: 9961471 time 0.040932
[08/16/2021-04:56:35] [V] [TRT] Tactic: 10027007 time 0.063992
[08/16/2021-04:56:35] [V] [TRT] Tactic: 10092543 time 0.194404
[08/16/2021-04:56:35] [V] [TRT] Tactic: 10289151 time 0.179612
[08/16/2021-04:56:35] [V] [TRT] Tactic: 10485759 time 0.035148
[08/16/2021-04:56:35] [V] [TRT] Tactic: 10682367 time 0.031076
[08/16/2021-04:56:35] [V] [TRT] Tactic: 10813439 time 0.05062
[08/16/2021-04:56:35] [V] [TRT] Fastest Tactic: 2621439 Time: 0.031048
[08/16/2021-04:56:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (CaskConvolution)
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:35] [V] [TRT] Tactic: 1145226902788474763 time 0.196728
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:35] [V] [TRT] Tactic: 2418518597804310654 time 0.191072
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:35] [V] [TRT] Tactic: 8292881859266835088 time 0.203
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:35] [V] [TRT] Tactic: 8401509141903434922 time 0.16284
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:35] [V] [TRT] Tactic: -8654297089785671176 time 0.282972
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:35] [V] [TRT] Tactic: -7448936905981214224 time 0.21624
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:35] [V] [TRT] Tactic: -3689982367035295496 time 0.28608
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:35] [V] [TRT] Tactic: -3140347171730126532 time 0.040948
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:35] [V] [TRT] Tactic: -2027588946874785071 time 0.16368
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:35] [V] [TRT] Tactic: -245090590808296743 time 0.29618
[08/16/2021-04:56:35] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.040948
[08/16/2021-04:56:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (CudaConvolution)
[08/16/2021-04:56:35] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (CudaDepthwiseConvolution)
[08/16/2021-04:56:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2621439
[08/16/2021-04:56:35] [V] [TRT] 
[08/16/2021-04:56:35] [V] [TRT] *************** Autotuning format combination: Half(32,256,1:8,2048) -> Float(1,8,64,1536) ***************
[08/16/2021-04:56:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (FusedConvActConvolution)
[08/16/2021-04:56:35] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (CaskConvolution)
[08/16/2021-04:56:35] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (CudaConvolution)
[08/16/2021-04:56:35] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (CudaDepthwiseConvolution)
[08/16/2021-04:56:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:35] [V] [TRT] *************** Autotuning format combination: Half(32,256,1:8,2048) -> Half(3,24,1:8,192) ***************
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (FusedConvActConvolution)
[08/16/2021-04:56:35] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (CaskConvolution)
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] Tactic: 3754069740140581927 time 0.097196
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] Tactic: 5925270497649423688 time 0.149592
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] Tactic: 6680916730816870145 time 0.08944
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] Tactic: 7158029511300006471 time 0.093684
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] Tactic: 7859952145590271433 time 0.088972
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] Tactic: 8283847742354150423 time 0.099264
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] Tactic: -4534876761957424274 time 0.147928
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] Tactic: -3237051169894153788 time 0.092476
[08/16/2021-04:56:35] [V] [TRT] Fastest Tactic: 7859952145590271433 Time: 0.088972
[08/16/2021-04:56:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (CudaConvolution)
[08/16/2021-04:56:35] [V] [TRT] Tactic: 0 time 1.90039
[08/16/2021-04:56:35] [V] [TRT] Tactic: 1 time 0.671664
[08/16/2021-04:56:35] [V] [TRT] Tactic: 2 time 0.193116
[08/16/2021-04:56:35] [V] [TRT] Tactic: 6 time 0.172036
[08/16/2021-04:56:35] [V] [TRT] Fastest Tactic: 6 Time: 0.172036
[08/16/2021-04:56:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (CudaDepthwiseConvolution)
[08/16/2021-04:56:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7859952145590271433
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] 
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:35] [V] [TRT] *************** Autotuning format combination: Float(1,8,64,16384) -> Float(1,8,64,34944) ***************
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:56:35] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:56:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (FusedConvActConvolution)
[08/16/2021-04:56:35] [V] [TRT] Tactic: 524287 time 0.431576
[08/16/2021-04:56:35] [V] [TRT] Tactic: 720895 time 0.547412
[08/16/2021-04:56:35] [V] [TRT] Tactic: 983039 time 0.443336
[08/16/2021-04:56:35] [V] [TRT] Tactic: 1048575 time 0.387936
[08/16/2021-04:56:36] [V] [TRT] Tactic: 1703935 time 0.320488
[08/16/2021-04:56:36] [V] [TRT] Tactic: 1769471 time 0.614164
[08/16/2021-04:56:36] [V] [TRT] Tactic: 1966079 time 0.483496
[08/16/2021-04:56:36] [V] [TRT] Tactic: 2031615 time 0.542312
[08/16/2021-04:56:36] [V] [TRT] Tactic: 2228223 time 0.452716
[08/16/2021-04:56:36] [V] [TRT] Tactic: 2424831 time 0.35342
[08/16/2021-04:56:36] [V] [TRT] Tactic: 2621439 time 0.319376
[08/16/2021-04:56:36] [V] [TRT] Tactic: 2752511 time 0.634452
[08/16/2021-04:56:36] [V] [TRT] Tactic: 3014655 time 0.450116
[08/16/2021-04:56:36] [V] [TRT] Tactic: 3145727 time 0.506292
[08/16/2021-04:56:36] [V] [TRT] Tactic: 3604479 time 0.468864
[08/16/2021-04:56:36] [V] [TRT] Tactic: 4390911 time 0.68486
[08/16/2021-04:56:36] [V] [TRT] Tactic: 5046271 time 0.43086
[08/16/2021-04:56:36] [V] [TRT] Tactic: 5963775 time 0.598576
[08/16/2021-04:56:36] [V] [TRT] Tactic: 6160383 time 0.427736
[08/16/2021-04:56:36] [V] [TRT] Tactic: 6488063 time 0.738804
[08/16/2021-04:56:36] [V] [TRT] Tactic: 6881279 time 0.606236
[08/16/2021-04:56:36] [V] [TRT] Tactic: 7274495 time 0.629308
[08/16/2021-04:56:36] [V] [TRT] Tactic: 7864319 time 0.633916
[08/16/2021-04:56:36] [V] [TRT] Tactic: 7995391 time 0.34484
[08/16/2021-04:56:36] [V] [TRT] Tactic: 8585215 time 0.519728
[08/16/2021-04:56:37] [V] [TRT] Tactic: 8847359 time 0.870568
[08/16/2021-04:56:37] [V] [TRT] Tactic: 8978431 time 0.59872
[08/16/2021-04:56:37] [V] [TRT] Tactic: 9043967 time 0.696712
[08/16/2021-04:56:37] [V] [TRT] Tactic: 9175039 time 0.468492
[08/16/2021-04:56:37] [V] [TRT] Tactic: 9502719 time 0.684276
[08/16/2021-04:56:37] [V] [TRT] Tactic: 9961471 time 0.461732
[08/16/2021-04:56:37] [V] [TRT] Tactic: 10027007 time 0.492876
[08/16/2021-04:56:37] [V] [TRT] Tactic: 10092543 time 0.684516
[08/16/2021-04:56:37] [V] [TRT] Tactic: 10289151 time 0.483432
[08/16/2021-04:56:37] [V] [TRT] Tactic: 10485759 time 0.51832
[08/16/2021-04:56:37] [V] [TRT] Tactic: 10682367 time 0.319572
[08/16/2021-04:56:37] [V] [TRT] Tactic: 10813439 time 0.247976
[08/16/2021-04:56:37] [V] [TRT] Fastest Tactic: 10813439 Time: 0.247976
[08/16/2021-04:56:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CaskConvolution)
[08/16/2021-04:56:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:56:37] [V] [TRT] Tactic: 1825138533642645384 time 0.564608
[08/16/2021-04:56:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:37] [V] [TRT] Tactic: 2775507031594384867 time 0.252224
[08/16/2021-04:56:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:56:37] [V] [TRT] Tactic: 2842488832350522458 time 0.593236
[08/16/2021-04:56:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:56:37] [V] [TRT] Tactic: 3915320020053085238 time 0.55586
[08/16/2021-04:56:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:56:37] [V] [TRT] Tactic: 6448355332020552203 time 0.574172
[08/16/2021-04:56:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:56:37] [V] [TRT] Tactic: 6808617066150061604 time 0.582332
[08/16/2021-04:56:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:56:37] [V] [TRT] Tactic: -8060443123034038864 time 0.619156
[08/16/2021-04:56:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:56:37] [V] [TRT] Tactic: -4420849921117327522 time 0.585384
[08/16/2021-04:56:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:56:37] [V] [TRT] Tactic: -3946921629105938337 time 0.744196
[08/16/2021-04:56:37] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.252224
[08/16/2021-04:56:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CudaConvolution)
[08/16/2021-04:56:37] [V] [TRT] Tactic: 0 time 0.448924
[08/16/2021-04:56:37] [V] [TRT] Tactic: 2 time 0.460304
[08/16/2021-04:56:37] [V] [TRT] Tactic: 5 skipped. Scratch requested: 611795456, available: 16777216
[08/16/2021-04:56:37] [V] [TRT] Tactic: 6 time 0.655436
[08/16/2021-04:56:37] [V] [TRT] Tactic: 57 time 0.954648
[08/16/2021-04:56:37] [V] [TRT] Fastest Tactic: 0 Time: 0.448924
[08/16/2021-04:56:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CudaDepthwiseConvolution)
[08/16/2021-04:56:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10813439
[08/16/2021-04:56:37] [V] [TRT] 
[08/16/2021-04:56:37] [V] [TRT] *************** Autotuning format combination: Half(1,8,64,16384) -> Half(1,8,64,34944) ***************
[08/16/2021-04:56:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (FusedConvActConvolution)
[08/16/2021-04:56:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CaskConvolution)
[08/16/2021-04:56:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CudaConvolution)
[08/16/2021-04:56:37] [V] [TRT] Tactic: 0 time 0.455168
[08/16/2021-04:56:37] [V] [TRT] Tactic: 1 time 0.85272
[08/16/2021-04:56:37] [V] [TRT] Tactic: 2 time 0.425772
[08/16/2021-04:56:37] [V] [TRT] Tactic: 4 skipped. Scratch requested: 327665664, available: 16777216
[08/16/2021-04:56:37] [V] [TRT] Tactic: 5 skipped. Scratch requested: 611795456, available: 16777216
[08/16/2021-04:56:37] [V] [TRT] Tactic: 6 skipped. Scratch requested: 19708928, available: 16777216
[08/16/2021-04:56:37] [V] [TRT] Fastest Tactic: 2 Time: 0.425772
[08/16/2021-04:56:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CudaDepthwiseConvolution)
[08/16/2021-04:56:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2
[08/16/2021-04:56:37] [V] [TRT] 
[08/16/2021-04:56:37] [V] [TRT] *************** Autotuning format combination: Half(1,8,64:2,8192) -> Half(1,8,64:2,17472) ***************
[08/16/2021-04:56:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:37] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (FusedConvActConvolution)
[08/16/2021-04:56:38] [V] [TRT] Tactic: 524287 time 0.220524
[08/16/2021-04:56:38] [V] [TRT] Tactic: 720895 time 0.344028
[08/16/2021-04:56:38] [V] [TRT] Tactic: 983039 time 0.22898
[08/16/2021-04:56:38] [V] [TRT] Tactic: 1048575 time 0.200424
[08/16/2021-04:56:38] [V] [TRT] Tactic: 1703935 time 0.16412
[08/16/2021-04:56:38] [V] [TRT] Tactic: 1769471 time 0.31752
[08/16/2021-04:56:38] [V] [TRT] Tactic: 1966079 time 0.290216
[08/16/2021-04:56:38] [V] [TRT] Tactic: 2031615 time 0.273748
[08/16/2021-04:56:38] [V] [TRT] Tactic: 2228223 time 0.230072
[08/16/2021-04:56:38] [V] [TRT] Tactic: 2424831 time 0.187884
[08/16/2021-04:56:38] [V] [TRT] Tactic: 2621439 time 0.167536
[08/16/2021-04:56:38] [V] [TRT] Tactic: 2752511 time 0.3752
[08/16/2021-04:56:38] [V] [TRT] Tactic: 3014655 time 0.215852
[08/16/2021-04:56:38] [V] [TRT] Tactic: 3145727 time 0.269128
[08/16/2021-04:56:38] [V] [TRT] Tactic: 3604479 time 0.215896
[08/16/2021-04:56:38] [V] [TRT] Tactic: 4390911 time 0.350728
[08/16/2021-04:56:38] [V] [TRT] Tactic: 5046271 time 0.276768
[08/16/2021-04:56:38] [V] [TRT] Tactic: 5963775 time 0.29646
[08/16/2021-04:56:38] [V] [TRT] Tactic: 6160383 time 0.212672
[08/16/2021-04:56:38] [V] [TRT] Tactic: 6488063 time 0.38334
[08/16/2021-04:56:38] [V] [TRT] Tactic: 6881279 time 0.311068
[08/16/2021-04:56:38] [V] [TRT] Tactic: 7274495 time 0.309412
[08/16/2021-04:56:38] [V] [TRT] Tactic: 7864319 time 0.335352
[08/16/2021-04:56:38] [V] [TRT] Tactic: 7995391 time 0.173536
[08/16/2021-04:56:38] [V] [TRT] Tactic: 8585215 time 0.271064
[08/16/2021-04:56:38] [V] [TRT] Tactic: 8847359 time 0.46286
[08/16/2021-04:56:38] [V] [TRT] Tactic: 8978431 time 0.302072
[08/16/2021-04:56:38] [V] [TRT] Tactic: 9043967 time 0.361636
[08/16/2021-04:56:39] [V] [TRT] Tactic: 9175039 time 0.216
[08/16/2021-04:56:39] [V] [TRT] Tactic: 9502719 time 0.344508
[08/16/2021-04:56:39] [V] [TRT] Tactic: 9961471 time 0.244512
[08/16/2021-04:56:39] [V] [TRT] Tactic: 10027007 time 0.285968
[08/16/2021-04:56:39] [V] [TRT] Tactic: 10092543 time 0.350156
[08/16/2021-04:56:39] [V] [TRT] Tactic: 10289151 time 0.291136
[08/16/2021-04:56:39] [V] [TRT] Tactic: 10485759 time 0.272736
[08/16/2021-04:56:39] [V] [TRT] Tactic: 10682367 time 0.165452
[08/16/2021-04:56:39] [V] [TRT] Tactic: 10813439 time 0.132092
[08/16/2021-04:56:39] [V] [TRT] Fastest Tactic: 10813439 Time: 0.132092
[08/16/2021-04:56:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CaskConvolution)
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:39] [V] [TRT] Tactic: 1145226902788474763 time 0.327356
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:39] [V] [TRT] Tactic: 2418518597804310654 time 0.323596
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:39] [V] [TRT] Tactic: 8292881859266835088 time 0.351732
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:39] [V] [TRT] Tactic: 8401509141903434922 time 0.302672
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:39] [V] [TRT] Tactic: -8654297089785671176 time 0.286024
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:39] [V] [TRT] Tactic: -7448936905981214224 time 0.374672
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:39] [V] [TRT] Tactic: -3689982367035295496 time 0.2896
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:39] [V] [TRT] Tactic: -3140347171730126532 time 0.129944
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:39] [V] [TRT] Tactic: -2027588946874785071 time 0.317776
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:39] [V] [TRT] Tactic: -245090590808296743 time 0.29756
[08/16/2021-04:56:39] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.129944
[08/16/2021-04:56:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CudaConvolution)
[08/16/2021-04:56:39] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CudaDepthwiseConvolution)
[08/16/2021-04:56:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:39] [V] [TRT] 
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:39] [V] [TRT] *************** Autotuning format combination: Half(32,256,1:8,2048) -> Float(1,8,64,34944) ***************
[08/16/2021-04:56:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (FusedConvActConvolution)
[08/16/2021-04:56:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CaskConvolution)
[08/16/2021-04:56:39] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CudaConvolution)
[08/16/2021-04:56:39] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CudaDepthwiseConvolution)
[08/16/2021-04:56:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:39] [V] [TRT] *************** Autotuning format combination: Half(32,256,1:8,2048) -> Half(69,552,1:8,4416) ***************
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (FusedConvActConvolution)
[08/16/2021-04:56:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CaskConvolution)
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] Tactic: 3754069740140581927 time 0.121456
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] Tactic: 5925270497649423688 time 0.157908
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] Tactic: 6680916730816870145 time 0.178908
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] Tactic: 7158029511300006471 time 0.1621
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] Tactic: 7859952145590271433 time 0.179396
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] Tactic: 8283847742354150423 time 0.126968
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] Tactic: -4534876761957424274 time 0.157044
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] Tactic: -3237051169894153788 time 0.15982
[08/16/2021-04:56:39] [V] [TRT] Fastest Tactic: 3754069740140581927 Time: 0.121456
[08/16/2021-04:56:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CudaConvolution)
[08/16/2021-04:56:39] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CudaDepthwiseConvolution)
[08/16/2021-04:56:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3754069740140581927
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] 
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:39] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,4194304) -> Float(1,128,16384,393216) ***************
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:56:39] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:56:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (FusedConvActConvolution)
[08/16/2021-04:56:39] [V] [TRT] Tactic: 524287 time 3.46726
[08/16/2021-04:56:40] [V] [TRT] Tactic: 720895 time 6.53034
[08/16/2021-04:56:40] [V] [TRT] Tactic: 983039 time 6.33204
[08/16/2021-04:56:40] [V] [TRT] Tactic: 1048575 time 3.33126
[08/16/2021-04:56:40] [V] [TRT] Tactic: 1703935 time 3.24126
[08/16/2021-04:56:40] [V] [TRT] Tactic: 1769471 time 7.26502
[08/16/2021-04:56:41] [V] [TRT] Tactic: 1966079 time 6.20336
[08/16/2021-04:56:41] [V] [TRT] Tactic: 2031615 time 6.47926
[08/16/2021-04:56:41] [V] [TRT] Tactic: 2228223 time 3.39342
[08/16/2021-04:56:41] [V] [TRT] Tactic: 2424831 time 3.37695
[08/16/2021-04:56:41] [V] [TRT] Tactic: 2621439 time 3.47807
[08/16/2021-04:56:42] [V] [TRT] Tactic: 2752511 time 6.4602
[08/16/2021-04:56:42] [V] [TRT] Tactic: 2818047 time 13.4428
[08/16/2021-04:56:43] [V] [TRT] Tactic: 2883583 time 12.3312
[08/16/2021-04:56:43] [V] [TRT] Tactic: 3014655 time 3.35048
[08/16/2021-04:56:43] [V] [TRT] Tactic: 3145727 time 6.3657
[08/16/2021-04:56:44] [V] [TRT] Tactic: 3473407 time 13.0394
[08/16/2021-04:56:44] [V] [TRT] Tactic: 3604479 time 3.33821
[08/16/2021-04:56:44] [V] [TRT] Tactic: 3735551 time 12.677
[08/16/2021-04:56:45] [V] [TRT] Tactic: 4390911 time 6.52626
[08/16/2021-04:56:45] [V] [TRT] Tactic: 5046271 time 3.4375
[08/16/2021-04:56:45] [V] [TRT] Tactic: 5963775 time 6.50657
[08/16/2021-04:56:45] [V] [TRT] Tactic: 6160383 time 3.48207
[08/16/2021-04:56:46] [V] [TRT] Tactic: 6488063 time 3.54603
[08/16/2021-04:56:46] [V] [TRT] Tactic: 6881279 time 6.52681
[08/16/2021-04:56:46] [V] [TRT] Tactic: 7274495 time 6.87879
[08/16/2021-04:56:46] [V] [TRT] Tactic: 7864319 time 3.54556
[08/16/2021-04:56:47] [V] [TRT] Tactic: 7995391 time 6.22575
[08/16/2021-04:56:47] [V] [TRT] Tactic: 8585215 time 3.39964
[08/16/2021-04:56:47] [V] [TRT] Tactic: 8847359 time 4.23233
[08/16/2021-04:56:47] [V] [TRT] Tactic: 8978431 time 6.51769
[08/16/2021-04:56:47] [V] [TRT] Tactic: 9043967 time 3.49575
[08/16/2021-04:56:47] [V] [TRT] Tactic: 9175039 time 3.32209
[08/16/2021-04:56:48] [V] [TRT] Tactic: 9502719 time 6.68742
[08/16/2021-04:56:48] [V] [TRT] Tactic: 9830399 time 12.5749
[08/16/2021-04:56:48] [V] [TRT] Tactic: 9961471 time 3.86743
[08/16/2021-04:56:49] [V] [TRT] Tactic: 10027007 time 3.36384
[08/16/2021-04:56:49] [V] [TRT] Tactic: 10092543 time 6.51799
[08/16/2021-04:56:49] [V] [TRT] Tactic: 10289151 time 6.2008
[08/16/2021-04:56:49] [V] [TRT] Tactic: 10485759 time 3.29893
[08/16/2021-04:56:49] [V] [TRT] Tactic: 10682367 time 3.34144
[08/16/2021-04:56:50] [V] [TRT] Tactic: 10813439 time 6.02709
[08/16/2021-04:56:50] [V] [TRT] Fastest Tactic: 1703935 Time: 3.24126
[08/16/2021-04:56:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (CaskConvolution)
[08/16/2021-04:56:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:56:50] [V] [TRT] Tactic: 1825138533642645384 time 11.8971
[08/16/2021-04:56:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:50] [V] [TRT] Tactic: 2775507031594384867 time 1.62621
[08/16/2021-04:56:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:56:50] [V] [TRT] Tactic: 2842488832350522458 time 6.08032
[08/16/2021-04:56:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:56:50] [V] [TRT] Tactic: 3915320020053085238 time 11.8494
[08/16/2021-04:56:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:56:50] [V] [TRT] Tactic: 6448355332020552203 time 12.1327
[08/16/2021-04:56:50] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:56:51] [V] [TRT] Tactic: 6808617066150061604 time 6.0946
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:56:51] [V] [TRT] Tactic: -8060443123034038864 time 6.16024
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:56:51] [V] [TRT] Tactic: -4420849921117327522 time 3.4661
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:56:51] [V] [TRT] Tactic: -3946921629105938337 time 3.2147
[08/16/2021-04:56:51] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 1.62621
[08/16/2021-04:56:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (CudaConvolution)
[08/16/2021-04:56:51] [V] [TRT] Tactic: 0 time 4.62231
[08/16/2021-04:56:51] [V] [TRT] Tactic: 2 skipped. Scratch requested: 150994944, available: 16777216
[08/16/2021-04:56:51] [V] [TRT] Tactic: 5 skipped. Scratch requested: 29175808, available: 16777216
[08/16/2021-04:56:51] [V] [TRT] Tactic: 6 time 1.7075
[08/16/2021-04:56:51] [V] [TRT] Tactic: 57 skipped. Scratch requested: 18891264, available: 16777216
[08/16/2021-04:56:51] [V] [TRT] Fastest Tactic: 6 Time: 1.7075
[08/16/2021-04:56:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (CudaDepthwiseConvolution)
[08/16/2021-04:56:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:51] [V] [TRT] 
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:51] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,4194304) -> Half(1,128,16384,393216) ***************
[08/16/2021-04:56:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (FusedConvActConvolution)
[08/16/2021-04:56:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (CaskConvolution)
[08/16/2021-04:56:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (CudaConvolution)
[08/16/2021-04:56:51] [V] [TRT] Tactic: 0 time 4.94116
[08/16/2021-04:56:51] [V] [TRT] Tactic: 1 time 5.49017
[08/16/2021-04:56:51] [V] [TRT] Tactic: 2 skipped. Scratch requested: 75497472, available: 16777216
[08/16/2021-04:56:51] [V] [TRT] Tactic: 4 skipped. Scratch requested: 3381878784, available: 16777216
[08/16/2021-04:56:51] [V] [TRT] Tactic: 5 skipped. Scratch requested: 29175808, available: 16777216
[08/16/2021-04:56:51] [V] [TRT] Tactic: 6 skipped. Scratch requested: 19317248, available: 16777216
[08/16/2021-04:56:51] [V] [TRT] Fastest Tactic: 0 Time: 4.94116
[08/16/2021-04:56:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (CudaDepthwiseConvolution)
[08/16/2021-04:56:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0
[08/16/2021-04:56:51] [V] [TRT] 
[08/16/2021-04:56:51] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,2097152) -> Half(1,128,16384:2,196608) ***************
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:51] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (FusedConvActConvolution)
[08/16/2021-04:56:51] [V] [TRT] Tactic: 524287 time 1.77234
[08/16/2021-04:56:51] [V] [TRT] Tactic: 720895 time 3.36808
[08/16/2021-04:56:51] [V] [TRT] Tactic: 983039 time 3.28205
[08/16/2021-04:56:52] [V] [TRT] Tactic: 1048575 time 1.63974
[08/16/2021-04:56:52] [V] [TRT] Tactic: 1703935 time 1.6303
[08/16/2021-04:56:52] [V] [TRT] Tactic: 1769471 time 3.76065
[08/16/2021-04:56:52] [V] [TRT] Tactic: 1966079 time 3.22482
[08/16/2021-04:56:52] [V] [TRT] Tactic: 2031615 time 3.25079
[08/16/2021-04:56:52] [V] [TRT] Tactic: 2228223 time 1.69764
[08/16/2021-04:56:52] [V] [TRT] Tactic: 2424831 time 1.74342
[08/16/2021-04:56:52] [V] [TRT] Tactic: 2621439 time 1.75782
[08/16/2021-04:56:53] [V] [TRT] Tactic: 2752511 time 3.48828
[08/16/2021-04:56:53] [V] [TRT] Tactic: 2818047 time 6.76446
[08/16/2021-04:56:53] [V] [TRT] Tactic: 2883583 time 6.22261
[08/16/2021-04:56:53] [V] [TRT] Tactic: 3014655 time 1.6366
[08/16/2021-04:56:53] [V] [TRT] Tactic: 3145727 time 3.24598
[08/16/2021-04:56:54] [V] [TRT] Tactic: 3473407 time 6.56949
[08/16/2021-04:56:54] [V] [TRT] Tactic: 3604479 time 1.63064
[08/16/2021-04:56:54] [V] [TRT] Tactic: 3735551 time 6.21844
[08/16/2021-04:56:54] [V] [TRT] Tactic: 4390911 time 3.26121
[08/16/2021-04:56:54] [V] [TRT] Tactic: 5046271 time 1.71779
[08/16/2021-04:56:54] [V] [TRT] Tactic: 5963775 time 3.30267
[08/16/2021-04:56:54] [V] [TRT] Tactic: 6160383 time 1.7404
[08/16/2021-04:56:54] [V] [TRT] Tactic: 6488063 time 1.79531
[08/16/2021-04:56:55] [V] [TRT] Tactic: 6881279 time 3.32694
[08/16/2021-04:56:55] [V] [TRT] Tactic: 7274495 time 3.37112
[08/16/2021-04:56:55] [V] [TRT] Tactic: 7864319 time 1.86216
[08/16/2021-04:56:55] [V] [TRT] Tactic: 7995391 time 3.53893
[08/16/2021-04:56:55] [V] [TRT] Tactic: 8585215 time 1.7574
[08/16/2021-04:56:55] [V] [TRT] Tactic: 8847359 time 2.19647
[08/16/2021-04:56:55] [V] [TRT] Tactic: 8978431 time 3.29009
[08/16/2021-04:56:55] [V] [TRT] Tactic: 9043967 time 1.73424
[08/16/2021-04:56:56] [V] [TRT] Tactic: 9175039 time 1.63113
[08/16/2021-04:56:56] [V] [TRT] Tactic: 9502719 time 3.27606
[08/16/2021-04:56:56] [V] [TRT] Tactic: 9830399 time 6.36367
[08/16/2021-04:56:56] [V] [TRT] Tactic: 9961471 time 1.94093
[08/16/2021-04:56:56] [V] [TRT] Tactic: 10027007 time 1.69919
[08/16/2021-04:56:56] [V] [TRT] Tactic: 10092543 time 3.2619
[08/16/2021-04:56:56] [V] [TRT] Tactic: 10289151 time 3.23328
[08/16/2021-04:56:57] [V] [TRT] Tactic: 10485759 time 1.67059
[08/16/2021-04:56:57] [V] [TRT] Tactic: 10682367 time 1.75268
[08/16/2021-04:56:57] [V] [TRT] Tactic: 10813439 time 3.12469
[08/16/2021-04:56:57] [V] [TRT] Fastest Tactic: 1703935 Time: 1.6303
[08/16/2021-04:56:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (CaskConvolution)
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:57] [V] [TRT] Tactic: 1145226902788474763 time 3.12078
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:57] [V] [TRT] Tactic: 2418518597804310654 time 3.13865
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:57] [V] [TRT] Tactic: 8292881859266835088 time 1.62796
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:57] [V] [TRT] Tactic: 8401509141903434922 time 3.10562
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:57] [V] [TRT] Tactic: -8654297089785671176 time 6.15404
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:57] [V] [TRT] Tactic: -7448936905981214224 time 1.70544
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:57] [V] [TRT] Tactic: -3689982367035295496 time 6.17123
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:57] [V] [TRT] Tactic: -3140347171730126532 time 0.81672
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:57] [V] [TRT] Tactic: -2027588946874785071 time 1.73564
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:57] [V] [TRT] Tactic: -245090590808296743 time 6.2639
[08/16/2021-04:56:57] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 0.81672
[08/16/2021-04:56:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (CudaConvolution)
[08/16/2021-04:56:57] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (CudaDepthwiseConvolution)
[08/16/2021-04:56:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:57] [V] [TRT] 
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:56:57] [V] [TRT] *************** Autotuning format combination: Half(32,4096,1:8,524288) -> Float(1,128,16384,393216) ***************
[08/16/2021-04:56:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (FusedConvActConvolution)
[08/16/2021-04:56:57] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (CaskConvolution)
[08/16/2021-04:56:57] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (CudaConvolution)
[08/16/2021-04:56:57] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (CudaDepthwiseConvolution)
[08/16/2021-04:56:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:57] [V] [TRT] *************** Autotuning format combination: Half(32,4096,1:8,524288) -> Half(3,384,1:8,49152) ***************
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (FusedConvActConvolution)
[08/16/2021-04:56:57] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:56:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (CaskConvolution)
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:57] [V] [TRT] Tactic: 3754069740140581927 time 1.73098
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:57] [V] [TRT] Tactic: 5925270497649423688 time 1.64603
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:57] [V] [TRT] Tactic: 6680916730816870145 time 1.02743
[08/16/2021-04:56:57] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:58] [V] [TRT] Tactic: 7158029511300006471 time 0.964084
[08/16/2021-04:56:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:58] [V] [TRT] Tactic: 7859952145590271433 time 1.02876
[08/16/2021-04:56:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:56:58] [V] [TRT] Tactic: 8283847742354150423 time 1.71772
[08/16/2021-04:56:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:58] [V] [TRT] Tactic: -4534876761957424274 time 1.64454
[08/16/2021-04:56:58] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:56:58] [V] [TRT] Tactic: -3237051169894153788 time 0.948092
[08/16/2021-04:56:58] [V] [TRT] Fastest Tactic: -3237051169894153788 Time: 0.948092
[08/16/2021-04:56:58] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (CudaConvolution)
[08/16/2021-04:57:03] [V] [TRT] Tactic: 0 time 354.202
[08/16/2021-04:57:03] [V] [TRT] Tactic: 1 time 5.6295
[08/16/2021-04:57:03] [V] [TRT] Tactic: 2 skipped. Scratch requested: 76284416, available: 16777216
[08/16/2021-04:57:03] [V] [TRT] Tactic: 6 skipped. Scratch requested: 19317248, available: 16777216
[08/16/2021-04:57:03] [V] [TRT] Fastest Tactic: 1 Time: 5.6295
[08/16/2021-04:57:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (CudaDepthwiseConvolution)
[08/16/2021-04:57:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:57:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3237051169894153788
[08/16/2021-04:57:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:57:03] [V] [TRT] 
[08/16/2021-04:57:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:57:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:57:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:57:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:57:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:57:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:57:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:57:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:57:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:57:03] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,4194304) -> Float(1,128,16384,8945664) ***************
[08/16/2021-04:57:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:57:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:57:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:57:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:57:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:57:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:57:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:57:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:57:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:57:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (FusedConvActConvolution)
[08/16/2021-04:57:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:57:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CaskConvolution)
[08/16/2021-04:57:03] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:57:04] [V] [TRT] Tactic: 1825138533642645384 time 58.9339
[08/16/2021-04:57:04] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:57:05] [V] [TRT] Tactic: 2775507031594384867 time 33.626
[08/16/2021-04:57:05] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:57:06] [V] [TRT] Tactic: 2842488832350522458 time 52.7338
[08/16/2021-04:57:06] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:57:07] [V] [TRT] Tactic: 3915320020053085238 time 58.7687
[08/16/2021-04:57:07] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:57:08] [V] [TRT] Tactic: 6448355332020552203 time 59.6272
[08/16/2021-04:57:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:57:09] [V] [TRT] Tactic: 6808617066150061604 time 53.745
[08/16/2021-04:57:09] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:57:10] [V] [TRT] Tactic: -8060443123034038864 time 53.8483
[08/16/2021-04:57:10] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:57:10] [V] [TRT] Tactic: -4420849921117327522 time 58.41
[08/16/2021-04:57:10] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:57:11] [V] [TRT] Tactic: -3946921629105938337 time 57.5037
[08/16/2021-04:57:11] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 33.626
[08/16/2021-04:57:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CudaConvolution)
[08/16/2021-04:57:13] [V] [TRT] Tactic: 0 time 74.5164
[08/16/2021-04:57:13] [V] [TRT] Tactic: 2 skipped. Scratch requested: 150994944, available: 16777216
[08/16/2021-04:57:13] [V] [TRT] Tactic: 5 skipped. Scratch requested: 615285760, available: 16777216
[08/16/2021-04:57:13] [V] [TRT] Tactic: 6 time 35.1793
[08/16/2021-04:57:14] [V] [TRT] Tactic: 57 time 67.9752
[08/16/2021-04:57:14] [V] [TRT] Fastest Tactic: 6 Time: 35.1793
[08/16/2021-04:57:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CudaDepthwiseConvolution)
[08/16/2021-04:57:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:57:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867
[08/16/2021-04:57:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:57:14] [V] [TRT] 
[08/16/2021-04:57:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[08/16/2021-04:57:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:57:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[08/16/2021-04:57:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[08/16/2021-04:57:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[08/16/2021-04:57:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[08/16/2021-04:57:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[08/16/2021-04:57:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[08/16/2021-04:57:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[08/16/2021-04:57:14] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:57:14] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,4194304) -> Half(1,128,16384,8945664) ***************
[08/16/2021-04:57:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (FusedConvActConvolution)
[08/16/2021-04:57:14] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:57:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CaskConvolution)
[08/16/2021-04:57:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:57:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CudaConvolution)
[08/16/2021-04:57:16] [V] [TRT] Tactic: 0 time 75.7834
[08/16/2021-04:57:17] [V] [TRT] Tactic: 1 time 76.307
[08/16/2021-04:57:17] [V] [TRT] Tactic: 2 skipped. Scratch requested: 75497472, available: 16777216
[08/16/2021-04:57:17] [V] [TRT] Tactic: 4 skipped. Scratch requested: 73995700224, available: 16777216
[08/16/2021-04:57:17] [V] [TRT] Tactic: 5 skipped. Scratch requested: 615285760, available: 16777216
[08/16/2021-04:57:17] [V] [TRT] Tactic: 6 skipped. Scratch requested: 72063488, available: 16777216
[08/16/2021-04:57:17] [V] [TRT] Fastest Tactic: 0 Time: 75.7834
[08/16/2021-04:57:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CudaDepthwiseConvolution)
[08/16/2021-04:57:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:57:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0
[08/16/2021-04:57:17] [V] [TRT] 
[08/16/2021-04:57:17] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384:2,2097152) -> Half(1,128,16384:2,4472832) ***************
[08/16/2021-04:57:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:57:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:57:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:57:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:57:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:57:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:57:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:57:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:57:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:57:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:57:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (FusedConvActConvolution)
[08/16/2021-04:57:17] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:57:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CaskConvolution)
[08/16/2021-04:57:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:57:17] [V] [TRT] Tactic: 1145226902788474763 time 27.1081
[08/16/2021-04:57:17] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:57:18] [V] [TRT] Tactic: 2418518597804310654 time 27.3551
[08/16/2021-04:57:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:57:18] [V] [TRT] Tactic: 8292881859266835088 time 28.8167
[08/16/2021-04:57:18] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:57:19] [V] [TRT] Tactic: 8401509141903434922 time 27.0325
[08/16/2021-04:57:19] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:57:19] [V] [TRT] Tactic: -8654297089785671176 time 29.9945
[08/16/2021-04:57:19] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:57:20] [V] [TRT] Tactic: -7448936905981214224 time 30.3155
[08/16/2021-04:57:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:57:20] [V] [TRT] Tactic: -3689982367035295496 time 30.104
[08/16/2021-04:57:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:57:20] [V] [TRT] Tactic: -3140347171730126532 time 15.4988
[08/16/2021-04:57:20] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:57:21] [V] [TRT] Tactic: -2027588946874785071 time 28.9706
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:57:21] [V] [TRT] Tactic: -245090590808296743 time 30.5408
[08/16/2021-04:57:21] [V] [TRT] Fastest Tactic: -3140347171730126532 Time: 15.4988
[08/16/2021-04:57:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CudaConvolution)
[08/16/2021-04:57:21] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:57:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CudaDepthwiseConvolution)
[08/16/2021-04:57:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:57:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3140347171730126532
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:57:21] [V] [TRT] 
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn) Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (hcudnn_winograd) Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[08/16/2021-04:57:21] [V] [TRT] *************** Autotuning format combination: Half(32,4096,1:8,524288) -> Float(1,128,16384,8945664) ***************
[08/16/2021-04:57:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (FusedConvActConvolution)
[08/16/2021-04:57:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:57:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CaskConvolution)
[08/16/2021-04:57:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[08/16/2021-04:57:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CudaConvolution)
[08/16/2021-04:57:21] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:57:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CudaDepthwiseConvolution)
[08/16/2021-04:57:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:57:21] [V] [TRT] *************** Autotuning format combination: Half(32,4096,1:8,524288) -> Half(69,8832,1:8,1130496) ***************
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:57:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (FusedConvActConvolution)
[08/16/2021-04:57:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[08/16/2021-04:57:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CaskConvolution)
[08/16/2021-04:57:21] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:57:22] [V] [TRT] Tactic: 3754069740140581927 time 9.2836
[08/16/2021-04:57:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:57:22] [V] [TRT] Tactic: 5925270497649423688 time 8.69348
[08/16/2021-04:57:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:57:22] [V] [TRT] Tactic: 6680916730816870145 time 9.09378
[08/16/2021-04:57:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:57:22] [V] [TRT] Tactic: 7158029511300006471 time 8.77519
[08/16/2021-04:57:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:57:22] [V] [TRT] Tactic: 7859952145590271433 time 9.12245
[08/16/2021-04:57:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:57:22] [V] [TRT] Tactic: 8283847742354150423 time 9.18346
[08/16/2021-04:57:22] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:57:23] [V] [TRT] Tactic: -4534876761957424274 time 9.0147
[08/16/2021-04:57:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:57:23] [V] [TRT] Tactic: -3237051169894153788 time 8.62229
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: -3237051169894153788 Time: 8.62229
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CudaConvolution)
[08/16/2021-04:57:23] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CudaDepthwiseConvolution)
[08/16/2021-04:57:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[08/16/2021-04:57:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3237051169894153788
[08/16/2021-04:57:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:57:23] [V] [TRT] 
[08/16/2021-04:57:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:57:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:57:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:57:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:57:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:57:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:57:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:57:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:57:23] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.129304
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.124
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.124
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.14
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.117448
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.117448
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.272208
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.08774
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.08774
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.270848
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.063008
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.063008
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.174532
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.079716
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.079716
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.173912
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.053744
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.053744
[08/16/2021-04:57:23] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,559104) -> Float(1,91,559104) ***************
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__359 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2 (Shuffle)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.174336
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1 time 0.249896
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.174336
[08/16/2021-04:57:23] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,559104) -> Half(1,91,559104) ***************
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__359 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2 (Shuffle)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.113688
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1 time 0.212148
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.113688
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.036724
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.038432
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.036724
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.040664
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.034004
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.034004
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.076416
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.0262
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0262
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.07452
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.01956
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.01956
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.047476
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.022852
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.022852
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.046616
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.01554
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.01554
[08/16/2021-04:57:23] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,139776) -> Float(1,91,139776) ***************
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__419 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 (Shuffle)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.039744
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1 time 0.072512
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.039744
[08/16/2021-04:57:23] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,139776) -> Half(1,91,139776) ***************
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__419 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 (Shuffle)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.033636
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1 time 0.063552
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.033636
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.009628
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.011536
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.009628
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.009584
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.01152
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.009584
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.047612
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.007676
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.007676
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.047876
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.007628
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.007628
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.015604
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.007564
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.007564
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.01554
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.007556
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.007556
[08/16/2021-04:57:23] [V] [TRT] *************** Autotuning format combination: Float(1,8,64,34944) -> Float(1,91,34944) ***************
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__479 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4 (Shuffle)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.013408
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1 time 0.018772
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.013408
[08/16/2021-04:57:23] [V] [TRT] *************** Autotuning format combination: Half(1,8,64,34944) -> Half(1,91,34944) ***************
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__479 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4 (Shuffle)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.011504
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1 time 0.018604
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.011504
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.47002
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.461568
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.461568
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.544764
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.449344
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.449344
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 1.03922
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.326372
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.326372
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 1.03797
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.231088
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.231088
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.641128
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.308688
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.308688
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 0.630104
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.209628
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.209628
[08/16/2021-04:57:23] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,2236416) -> Float(1,91,2236416) ***************
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__548 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 (Shuffle)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.734244
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1 time 0.977888
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.734244
[08/16/2021-04:57:23] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,2236416) -> Half(1,91,2236416) ***************
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__548 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 (Shuffle)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 0 time 0.460492
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1 time 0.809716
[08/16/2021-04:57:23] [V] [TRT] Fastest Tactic: 0 Time: 0.460492
[08/16/2021-04:57:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:23] [V] [TRT] Tactic: 1002 time 1.88509
[08/16/2021-04:57:24] [V] [TRT] Tactic: 0 time 1.81544
[08/16/2021-04:57:24] [V] [TRT] Fastest Tactic: 0 Time: 1.81544
[08/16/2021-04:57:24] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:24] [V] [TRT] Tactic: 1002 time 2.31114
[08/16/2021-04:57:24] [V] [TRT] Tactic: 0 time 1.77616
[08/16/2021-04:57:24] [V] [TRT] Fastest Tactic: 0 Time: 1.77616
[08/16/2021-04:57:24] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:24] [V] [TRT] Tactic: 1002 time 4.24894
[08/16/2021-04:57:24] [V] [TRT] Tactic: 0 time 1.1674
[08/16/2021-04:57:24] [V] [TRT] Fastest Tactic: 0 Time: 1.1674
[08/16/2021-04:57:24] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:24] [V] [TRT] Tactic: 1002 time 4.20657
[08/16/2021-04:57:24] [V] [TRT] Tactic: 0 time 0.890724
[08/16/2021-04:57:24] [V] [TRT] Fastest Tactic: 0 Time: 0.890724
[08/16/2021-04:57:24] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:24] [V] [TRT] Tactic: 1002 time 2.54236
[08/16/2021-04:57:24] [V] [TRT] Tactic: 0 time 1.25127
[08/16/2021-04:57:24] [V] [TRT] Fastest Tactic: 0 Time: 1.25127
[08/16/2021-04:57:24] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:24] [V] [TRT] Tactic: 1002 time 2.49933
[08/16/2021-04:57:24] [V] [TRT] Tactic: 0 time 0.84362
[08/16/2021-04:57:24] [V] [TRT] Fastest Tactic: 0 Time: 0.84362
[08/16/2021-04:57:24] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,8945664) -> Float(1,91,8945664) ***************
[08/16/2021-04:57:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__617 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape (Shuffle)
[08/16/2021-04:57:24] [V] [TRT] Tactic: 0 time 5.0159
[08/16/2021-04:57:24] [V] [TRT] Tactic: 1 skipped. Scratch requested: 35782656, available: 16777216
[08/16/2021-04:57:24] [V] [TRT] Fastest Tactic: 0 Time: 5.0159
[08/16/2021-04:57:24] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,8945664) -> Half(1,91,8945664) ***************
[08/16/2021-04:57:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__617 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape (Shuffle)
[08/16/2021-04:57:24] [V] [TRT] Tactic: 0 time 3.0476
[08/16/2021-04:57:24] [V] [TRT] Tactic: 1 skipped. Scratch requested: 17891328, available: 16777216
[08/16/2021-04:57:24] [V] [TRT] Fastest Tactic: 0 Time: 3.0476
[08/16/2021-04:57:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape:0 copy (Reformat)
[08/16/2021-04:57:24] [V] [TRT] Tactic: 1002 time 2.2424
[08/16/2021-04:57:24] [V] [TRT] Tactic: 0 time 1.5189
[08/16/2021-04:57:24] [V] [TRT] Fastest Tactic: 0 Time: 1.5189
[08/16/2021-04:57:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape:0 copy (Reformat)
[08/16/2021-04:57:24] [V] [TRT] Tactic: 1002 time 2.00308
[08/16/2021-04:57:24] [V] [TRT] Tactic: 0 time 1.22973
[08/16/2021-04:57:24] [V] [TRT] Fastest Tactic: 0 Time: 1.22973
[08/16/2021-04:57:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape:0 copy (Reformat)
[08/16/2021-04:57:24] [V] [TRT] Tactic: 1002 time 2.30565
[08/16/2021-04:57:24] [V] [TRT] Tactic: 0 time 1.28933
[08/16/2021-04:57:24] [V] [TRT] Fastest Tactic: 0 Time: 1.28933
[08/16/2021-04:57:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape:0 copy (Reformat)
[08/16/2021-04:57:24] [V] [TRT] Tactic: 1002 time 2.00299
[08/16/2021-04:57:24] [V] [TRT] Tactic: 0 time 1.12638
[08/16/2021-04:57:24] [V] [TRT] Fastest Tactic: 0 Time: 1.12638
[08/16/2021-04:57:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 copy (Reformat)
[08/16/2021-04:57:24] [V] [TRT] Tactic: 1002 time 0.569336
[08/16/2021-04:57:24] [V] [TRT] Tactic: 0 time 0.384796
[08/16/2021-04:57:24] [V] [TRT] Fastest Tactic: 0 Time: 0.384796
[08/16/2021-04:57:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 copy (Reformat)
[08/16/2021-04:57:24] [V] [TRT] Tactic: 1002 time 0.527136
[08/16/2021-04:57:24] [V] [TRT] Tactic: 0 time 0.31294
[08/16/2021-04:57:24] [V] [TRT] Fastest Tactic: 0 Time: 0.31294
[08/16/2021-04:57:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 copy (Reformat)
[08/16/2021-04:57:24] [V] [TRT] Tactic: 1002 time 0.564756
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.327924
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.327924
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 copy (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.511928
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.287172
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.287172
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2:0 copy (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.148192
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.102532
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.102532
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2:0 copy (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.13828
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.0887
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0887
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2:0 copy (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.149128
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.087224
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.087224
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2:0 copy (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.133868
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.077964
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.077964
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 copy (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.043324
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.030644
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.030644
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 copy (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.041216
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.026424
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.026424
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 copy (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.043344
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.026788
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.026788
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 copy (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.039932
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.024652
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.024652
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4:0 copy (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.00968
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.0096
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0096
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4:0 copy (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.009732
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.009608
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.009608
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4:0 copy (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.00978
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.009612
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.009612
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4:0 copy (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.009664
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.009644
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.009644
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 2.51435
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 2.41494
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 2.41494
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 3.01699
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 2.36388
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 2.36388
[08/16/2021-04:57:25] [V] [TRT] *************** Autotuning format combination: Float(1,91,11915904) -> Float(1,91,11915904) ***************
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/convert_scores (Activation)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 2.10152
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 2.10152
[08/16/2021-04:57:25] [V] [TRT] *************** Autotuning format combination: Half(1,91,11915904) -> Half(1,91,11915904) ***************
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/convert_scores (Activation)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 1.3111
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 1.3111
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.007736
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.009576
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.007736
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.00758
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.0096
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.00758
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.017404
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.007628
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.007628
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.017424
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.0076
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0076
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.019336
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.007564
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.007564
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.019312
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.005564
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.005564
[08/16/2021-04:57:25] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,24576) -> Float(1,4,24576) ***************
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__386 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 (Shuffle)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.009532
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1 time 0.017872
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.009532
[08/16/2021-04:57:25] [V] [TRT] *************** Autotuning format combination: Half(1,32,1024,24576) -> Half(1,4,24576) ***************
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__386 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 (Shuffle)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.009568
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1 time 0.016888
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.009568
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.005852
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.00564
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00564
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.006004
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.00564
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00564
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.009556
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.005536
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.005536
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.009528
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.005616
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.005616
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.011508
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.005672
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.005672
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.01148
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.005548
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.005548
[08/16/2021-04:57:25] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,6144) -> Float(1,4,6144) ***************
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__446 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 (Shuffle)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.00574
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1 time 0.012964
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00574
[08/16/2021-04:57:25] [V] [TRT] *************** Autotuning format combination: Half(1,16,256,6144) -> Half(1,4,6144) ***************
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__446 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 (Shuffle)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.00578
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1 time 0.012936
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00578
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.005668
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.005724
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.005668
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.005708
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.005784
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.005708
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.007536
[08/16/2021-04:57:25] [V] [TRT] Tactic: 0 time 0.005608
[08/16/2021-04:57:25] [V] [TRT] Fastest Tactic: 0 Time: 0.005608
[08/16/2021-04:57:25] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:25] [V] [TRT] Tactic: 1002 time 0.007708
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.005664
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.005664
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.009572
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.005584
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.005584
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.00966
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.005448
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.005448
[08/16/2021-04:57:26] [V] [TRT] *************** Autotuning format combination: Float(1,8,64,1536) -> Float(1,4,1536) ***************
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__506 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 (Shuffle)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.005616
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1 time 0.012996
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.005616
[08/16/2021-04:57:26] [V] [TRT] *************** Autotuning format combination: Half(1,8,64,1536) -> Half(1,4,1536) ***************
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__506 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 (Shuffle)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.005676
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1 time 0.012952
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.005676
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.027664
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.0288
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.027664
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.03038
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.0255
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.0255
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.054184
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.0197
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.0197
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.049852
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.012444
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.012444
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.05734
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.016984
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.016984
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.053892
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.009304
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.009304
[08/16/2021-04:57:26] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,98304) -> Float(1,4,98304) ***************
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__575 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 (Shuffle)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.025956
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1 time 0.05844
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.025956
[08/16/2021-04:57:26] [V] [TRT] *************** Autotuning format combination: Half(1,64,4096,98304) -> Half(1,4,98304) ***************
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__575 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 (Shuffle)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.01886
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1 time 0.039324
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.01886
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.08876
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.089724
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.08876
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.100032
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.084348
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.084348
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.192048
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.056328
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.056328
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.190716
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.04446
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.04446
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.203284
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.055412
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.055412
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.205004
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.038636
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.038636
[08/16/2021-04:57:26] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,393216) -> Float(1,4,393216) ***************
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__644 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape (Shuffle)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.081236
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1 time 0.195888
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.081236
[08/16/2021-04:57:26] [V] [TRT] *************** Autotuning format combination: Half(1,128,16384,393216) -> Half(1,4,393216) ***************
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__644 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape (Shuffle)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.06318
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1 time 0.175264
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.06318
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.104496
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.073856
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.073856
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.095184
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.061156
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.061156
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.102768
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.063832
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.063832
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.092468
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.055884
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.055884
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.032344
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.023504
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.023504
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.030016
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.020524
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.020524
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.031548
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.020948
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.020948
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.016564
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.018272
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.016564
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.008768
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.007708
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.007708
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.010032
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.008888
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.008888
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.00898
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.0093
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.00898
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.009216
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.00764
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.00764
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.007608
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.005668
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.005668
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.007644
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.005748
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.005748
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.007672
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.005684
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.005684
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.007748
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.005556
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.005556
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.005856
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.005784
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.005784
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.006016
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.005776
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.005776
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.005668
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.00564
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.00564
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.006716
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.00564
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.00564
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.116844
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.116704
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.116704
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.130836
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.110412
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.110412
[08/16/2021-04:57:26] [V] [TRT] *************** Autotuning format combination: Float(1,4,523776) -> Float(1,130944) ***************
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Reshape_1 + StatefulPartitionedCall/Postprocessor/Decode/transpose (Shuffle)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.221944
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1 time 0.489592
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.221944
[08/16/2021-04:57:26] [V] [TRT] *************** Autotuning format combination: Half(1,4,523776) -> Half(1,130944) ***************
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Reshape_1 + StatefulPartitionedCall/Postprocessor/Decode/transpose (Shuffle)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.1165
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1 time 0.480548
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.1165
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.1251
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.115976
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.115976
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.135448
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.110136
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.110136
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack_1 (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.03862
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.027608
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.027608
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack_1 (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.034912
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.036204
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.034912
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack_1 (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.03766
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.032184
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.032184
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack_1 (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.03198
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.013844
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 0 Time: 0.013844
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.034652
[08/16/2021-04:57:26] [V] [TRT] Tactic: 0 time 0.036824
[08/16/2021-04:57:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.034652
[08/16/2021-04:57:26] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:26] [V] [TRT] Tactic: 1002 time 0.038124
[08/16/2021-04:57:27] [V] [TRT] Tactic: 0 time 0.032312
[08/16/2021-04:57:27] [V] [TRT] Fastest Tactic: 0 Time: 0.032312
[08/16/2021-04:57:27] [V] [TRT] *************** Autotuning format combination: Float(1,130944) -> Float(1) ***************
[08/16/2021-04:57:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack__648 (Shuffle)
[08/16/2021-04:57:27] [V] [TRT] Tactic: 0 time 0.027624
[08/16/2021-04:57:27] [V] [TRT] Tactic: 1 time 0.076564
[08/16/2021-04:57:27] [V] [TRT] Fastest Tactic: 0 Time: 0.027624
[08/16/2021-04:57:27] [V] [TRT] *************** Autotuning format combination: Half(1,130944) -> Half(1) ***************
[08/16/2021-04:57:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack__648 (Shuffle)
[08/16/2021-04:57:27] [V] [TRT] Tactic: 0 time 0.013224
[08/16/2021-04:57:27] [V] [TRT] Tactic: 1 time 0.066808
[08/16/2021-04:57:27] [V] [TRT] Fastest Tactic: 0 Time: 0.013224
[08/16/2021-04:57:27] [V] [TRT] *************** Autotuning format combination:  -> Float(1) ***************
[08/16/2021-04:57:27] [V] [TRT] *************** Autotuning format combination:  -> Half(1) ***************
[08/16/2021-04:57:27] [V] [TRT] *************** Autotuning format combination:  -> Float(1) ***************
[08/16/2021-04:57:27] [V] [TRT] *************** Autotuning format combination:  -> Half(1) ***************
[08/16/2021-04:57:27] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:27] [V] [TRT] Tactic: 1002 time 0.03762
[08/16/2021-04:57:27] [V] [TRT] Tactic: 0 time 0.036292
[08/16/2021-04:57:27] [V] [TRT] Fastest Tactic: 0 Time: 0.036292
[08/16/2021-04:57:27] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:27] [V] [TRT] Tactic: 1002 time 0.039716
[08/16/2021-04:57:27] [V] [TRT] Tactic: 0 time 0.0324
[08/16/2021-04:57:27] [V] [TRT] Fastest Tactic: 0 Time: 0.0324
[08/16/2021-04:57:27] [V] [TRT] *************** Autotuning format combination: Float(1), Float(1), Float(1) -> Float(1) ***************
[08/16/2021-04:57:36] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN((Unnamed Layer* 302) [Constant] + (Unnamed Layer* 303) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_1), StatefulPartitionedCall/Postprocessor/Decode/mul_3), StatefulPartitionedCall/Postprocessor/Decode/add_1) (PointWise)
[08/16/2021-04:57:36] [V] [TRT] Tactic: 128 time 0.05174
[08/16/2021-04:57:36] [V] [TRT] Tactic: 256 time 0.051596
[08/16/2021-04:57:36] [V] [TRT] Tactic: 512 time 0.052336
[08/16/2021-04:57:36] [V] [TRT] Tactic: -32 time 0.074652
[08/16/2021-04:57:36] [V] [TRT] Tactic: -64 time 0.073968
[08/16/2021-04:57:36] [V] [TRT] Tactic: -128 time 0.062284
[08/16/2021-04:57:36] [V] [TRT] Fastest Tactic: 256 Time: 0.051596
[08/16/2021-04:57:36] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN((Unnamed Layer* 302) [Constant] + (Unnamed Layer* 303) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_1), StatefulPartitionedCall/Postprocessor/Decode/mul_3), StatefulPartitionedCall/Postprocessor/Decode/add_1) (PointWiseV2)
[08/16/2021-04:57:36] [V] [TRT] Tactic: 0 time 0.049044
[08/16/2021-04:57:36] [V] [TRT] Tactic: 1 time 0.04958
[08/16/2021-04:57:36] [V] [TRT] Tactic: 2 time 0.049032
[08/16/2021-04:57:36] [V] [TRT] Tactic: 3 time 0.049536
[08/16/2021-04:57:36] [V] [TRT] Tactic: 4 time 0.049572
[08/16/2021-04:57:36] [V] [TRT] Tactic: 5 time 0.049436
[08/16/2021-04:57:36] [V] [TRT] Tactic: 6 time 0.051056
[08/16/2021-04:57:36] [V] [TRT] Tactic: 7 time 0.05018
[08/16/2021-04:57:36] [V] [TRT] Tactic: 8 time 0.04944
[08/16/2021-04:57:36] [V] [TRT] Tactic: 9 time 0.051376
[08/16/2021-04:57:36] [V] [TRT] Tactic: 28 time 0.049308
[08/16/2021-04:57:36] [V] [TRT] Fastest Tactic: 2 Time: 0.049032
[08/16/2021-04:57:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2
[08/16/2021-04:57:36] [V] [TRT] 
[08/16/2021-04:57:36] [V] [TRT] *************** Autotuning format combination: Half(1), Half(1), Half(1) -> Half(1) ***************
[08/16/2021-04:57:45] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN((Unnamed Layer* 302) [Constant] + (Unnamed Layer* 303) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_1), StatefulPartitionedCall/Postprocessor/Decode/mul_3), StatefulPartitionedCall/Postprocessor/Decode/add_1) (PointWise)
[08/16/2021-04:57:45] [V] [TRT] Tactic: 128 time 0.079112
[08/16/2021-04:57:45] [V] [TRT] Tactic: 256 time 0.076612
[08/16/2021-04:57:45] [V] [TRT] Tactic: 512 time 0.078012
[08/16/2021-04:57:45] [V] [TRT] Tactic: -32 time 0.121384
[08/16/2021-04:57:45] [V] [TRT] Tactic: -64 time 0.118012
[08/16/2021-04:57:45] [V] [TRT] Tactic: -128 time 0.096468
[08/16/2021-04:57:45] [V] [TRT] Fastest Tactic: 256 Time: 0.076612
[08/16/2021-04:57:45] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN((Unnamed Layer* 302) [Constant] + (Unnamed Layer* 303) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_1), StatefulPartitionedCall/Postprocessor/Decode/mul_3), StatefulPartitionedCall/Postprocessor/Decode/add_1) (PointWiseV2)
[08/16/2021-04:57:45] [V] [TRT] Tactic: 0 time 0.034244
[08/16/2021-04:57:45] [V] [TRT] Tactic: 1 time 0.031948
[08/16/2021-04:57:45] [V] [TRT] Tactic: 2 time 0.030232
[08/16/2021-04:57:45] [V] [TRT] Tactic: 3 time 0.031544
[08/16/2021-04:57:45] [V] [TRT] Tactic: 4 time 0.030624
[08/16/2021-04:57:45] [V] [TRT] Tactic: 5 time 0.030628
[08/16/2021-04:57:45] [V] [TRT] Tactic: 6 time 0.034148
[08/16/2021-04:57:45] [V] [TRT] Tactic: 7 time 0.03148
[08/16/2021-04:57:45] [V] [TRT] Tactic: 8 time 0.03084
[08/16/2021-04:57:45] [V] [TRT] Tactic: 9 time 0.030416
[08/16/2021-04:57:45] [V] [TRT] Tactic: 28 time 0.03378
[08/16/2021-04:57:45] [V] [TRT] Fastest Tactic: 2 Time: 0.030232
[08/16/2021-04:57:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2
[08/16/2021-04:57:45] [V] [TRT] 
[08/16/2021-04:57:45] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:45] [V] [TRT] Tactic: 1002 time 0.046912
[08/16/2021-04:57:45] [V] [TRT] Tactic: 0 time 0.053832
[08/16/2021-04:57:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.046912
[08/16/2021-04:57:45] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:57:45] [V] [TRT] Tactic: 1002 time 0.050008
[08/16/2021-04:57:45] [V] [TRT] Tactic: 0 time 0.049496
[08/16/2021-04:57:45] [V] [TRT] Fastest Tactic: 0 Time: 0.049496
[08/16/2021-04:57:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack_3 (Reformat)
[08/16/2021-04:57:45] [V] [TRT] Tactic: 1002 time 0.046048
[08/16/2021-04:57:45] [V] [TRT] Tactic: 0 time 0.029892
[08/16/2021-04:57:45] [V] [TRT] Fastest Tactic: 0 Time: 0.029892
[08/16/2021-04:57:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack_3 (Reformat)
[08/16/2021-04:57:45] [V] [TRT] Tactic: 1002 time 0.043
[08/16/2021-04:57:45] [V] [TRT] Tactic: 0 time 0.053644
[08/16/2021-04:57:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.043
[08/16/2021-04:57:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack_3 (Reformat)
[08/16/2021-04:57:45] [V] [TRT] Tactic: 1002 time 0.046316
[08/16/2021-04:57:45] [V] [TRT] Tactic: 0 time 0.04948
[08/16/2021-04:57:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.046316
[08/16/2021-04:57:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack_3 (Reformat)
[08/16/2021-04:57:45] [V] [TRT] Tactic: 1002 time 0.04052
[08/16/2021-04:57:45] [V] [TRT] Tactic: 0 time 0.017836
[08/16/2021-04:57:45] [V] [TRT] Fastest Tactic: 0 Time: 0.017836
[08/16/2021-04:57:45] [V] [TRT] *************** Autotuning format combination: Float(1,130944) -> Float(1) ***************
[08/16/2021-04:57:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack__650 (Shuffle)
[08/16/2021-04:57:45] [V] [TRT] Tactic: 0 time 0.030256
[08/16/2021-04:57:45] [V] [TRT] Tactic: 1 time 0.092176
[08/16/2021-04:57:45] [V] [TRT] Fastest Tactic: 0 Time: 0.030256
[08/16/2021-04:57:45] [V] [TRT] *************** Autotuning format combination: Half(1,130944) -> Half(1) ***************
[08/16/2021-04:57:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack__650 (Shuffle)
[08/16/2021-04:57:45] [V] [TRT] Tactic: 0 time 0.016788
[08/16/2021-04:57:45] [V] [TRT] Tactic: 1 time 0.08364
[08/16/2021-04:57:45] [V] [TRT] Fastest Tactic: 0 Time: 0.016788
[08/16/2021-04:57:45] [V] [TRT] *************** Autotuning format combination:  -> Float(1) ***************
[08/16/2021-04:57:45] [V] [TRT] *************** Autotuning format combination:  -> Half(1) ***************
[08/16/2021-04:57:45] [V] [TRT] *************** Autotuning format combination: Float(1), Float(1) -> Float(1) ***************
[08/16/2021-04:57:54] [V] [TRT] --------------- Timing Runner: PWN((Unnamed Layer* 322) [Constant] + (Unnamed Layer* 323) [Shuffle], PWN(PWN(PWN(PWN((Unnamed Layer* 296) [Constant] + (Unnamed Layer* 297) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_3), StatefulPartitionedCall/Postprocessor/Decode/Exp), StatefulPartitionedCall/Postprocessor/Decode/mul), StatefulPartitionedCall/Postprocessor/Decode/truediv_5)) (PointWise)
[08/16/2021-04:57:54] [V] [TRT] Tactic: 128 time 0.096792
[08/16/2021-04:57:54] [V] [TRT] Tactic: 256 time 0.097136
[08/16/2021-04:57:54] [V] [TRT] Tactic: 512 time 0.09812
[08/16/2021-04:57:54] [V] [TRT] Tactic: -32 time 0.14512
[08/16/2021-04:57:54] [V] [TRT] Tactic: -64 time 0.132996
[08/16/2021-04:57:54] [V] [TRT] Tactic: -128 time 0.11658
[08/16/2021-04:57:54] [V] [TRT] Fastest Tactic: 128 Time: 0.096792
[08/16/2021-04:57:54] [V] [TRT] --------------- Timing Runner: PWN((Unnamed Layer* 322) [Constant] + (Unnamed Layer* 323) [Shuffle], PWN(PWN(PWN(PWN((Unnamed Layer* 296) [Constant] + (Unnamed Layer* 297) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_3), StatefulPartitionedCall/Postprocessor/Decode/Exp), StatefulPartitionedCall/Postprocessor/Decode/mul), StatefulPartitionedCall/Postprocessor/Decode/truediv_5)) (PointWiseV2)
[08/16/2021-04:57:54] [V] [TRT] Tactic: 0 time 0.041892
[08/16/2021-04:57:54] [V] [TRT] Tactic: 1 time 0.04188
[08/16/2021-04:57:54] [V] [TRT] Tactic: 2 time 0.041988
[08/16/2021-04:57:54] [V] [TRT] Tactic: 3 time 0.042616
[08/16/2021-04:57:54] [V] [TRT] Tactic: 4 time 0.04186
[08/16/2021-04:57:54] [V] [TRT] Tactic: 5 time 0.040988
[08/16/2021-04:57:54] [V] [TRT] Tactic: 6 time 0.04454
[08/16/2021-04:57:54] [V] [TRT] Tactic: 7 time 0.043636
[08/16/2021-04:57:54] [V] [TRT] Tactic: 8 time 0.041388
[08/16/2021-04:57:54] [V] [TRT] Tactic: 9 time 0.041256
[08/16/2021-04:57:54] [V] [TRT] Tactic: 28 time 0.041668
[08/16/2021-04:57:54] [V] [TRT] Fastest Tactic: 5 Time: 0.040988
[08/16/2021-04:57:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5
[08/16/2021-04:57:54] [V] [TRT] 
[08/16/2021-04:57:54] [V] [TRT] *************** Autotuning format combination: Half(1), Half(1) -> Half(1) ***************
[08/16/2021-04:58:03] [V] [TRT] --------------- Timing Runner: PWN((Unnamed Layer* 322) [Constant] + (Unnamed Layer* 323) [Shuffle], PWN(PWN(PWN(PWN((Unnamed Layer* 296) [Constant] + (Unnamed Layer* 297) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_3), StatefulPartitionedCall/Postprocessor/Decode/Exp), StatefulPartitionedCall/Postprocessor/Decode/mul), StatefulPartitionedCall/Postprocessor/Decode/truediv_5)) (PointWise)
[08/16/2021-04:58:03] [V] [TRT] Tactic: 128 time 0.173676
[08/16/2021-04:58:03] [V] [TRT] Tactic: 256 time 0.153216
[08/16/2021-04:58:03] [V] [TRT] Tactic: 512 time 0.143664
[08/16/2021-04:58:03] [V] [TRT] Tactic: -32 time 0.215248
[08/16/2021-04:58:03] [V] [TRT] Tactic: -64 time 0.20564
[08/16/2021-04:58:03] [V] [TRT] Tactic: -128 time 0.172816
[08/16/2021-04:58:03] [V] [TRT] Fastest Tactic: 512 Time: 0.143664
[08/16/2021-04:58:03] [V] [TRT] --------------- Timing Runner: PWN((Unnamed Layer* 322) [Constant] + (Unnamed Layer* 323) [Shuffle], PWN(PWN(PWN(PWN((Unnamed Layer* 296) [Constant] + (Unnamed Layer* 297) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_3), StatefulPartitionedCall/Postprocessor/Decode/Exp), StatefulPartitionedCall/Postprocessor/Decode/mul), StatefulPartitionedCall/Postprocessor/Decode/truediv_5)) (PointWiseV2)
[08/16/2021-04:58:03] [V] [TRT] Tactic: 0 time 0.0501
[08/16/2021-04:58:03] [V] [TRT] Tactic: 1 time 0.042616
[08/16/2021-04:58:03] [V] [TRT] Tactic: 2 time 0.036696
[08/16/2021-04:58:03] [V] [TRT] Tactic: 3 time 0.039476
[08/16/2021-04:58:03] [V] [TRT] Tactic: 4 time 0.036176
[08/16/2021-04:58:03] [V] [TRT] Tactic: 5 time 0.034968
[08/16/2021-04:58:03] [V] [TRT] Tactic: 6 time 0.042236
[08/16/2021-04:58:03] [V] [TRT] Tactic: 7 time 0.03678
[08/16/2021-04:58:03] [V] [TRT] Tactic: 8 time 0.036084
[08/16/2021-04:58:03] [V] [TRT] Tactic: 9 time 0.035844
[08/16/2021-04:58:03] [V] [TRT] Tactic: 28 time 0.048332
[08/16/2021-04:58:03] [V] [TRT] Fastest Tactic: 5 Time: 0.034968
[08/16/2021-04:58:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5
[08/16/2021-04:58:03] [V] [TRT] 
[08/16/2021-04:58:03] [V] [TRT] *************** Autotuning format combination: Float(1), Float(1) -> Float(1) ***************
[08/16/2021-04:58:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/sub_1 (ElementWise)
[08/16/2021-04:58:03] [V] [TRT] Tactic: 1 time 0.054232
[08/16/2021-04:58:03] [V] [TRT] Tactic: 2 time 0.071468
[08/16/2021-04:58:03] [V] [TRT] Fastest Tactic: 1 Time: 0.054232
[08/16/2021-04:58:03] [V] [TRT] *************** Autotuning format combination: Half(1), Half(1) -> Half(1) ***************
[08/16/2021-04:58:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/sub_1 (ElementWise)
[08/16/2021-04:58:03] [V] [TRT] Tactic: 1 time 0.034412
[08/16/2021-04:58:03] [V] [TRT] Tactic: 2 time 0.044916
[08/16/2021-04:58:03] [V] [TRT] Fastest Tactic: 1 Time: 0.034412
[08/16/2021-04:58:03] [V] [TRT] *************** Autotuning format combination: Float(1) -> Float(1,130944) ***************
[08/16/2021-04:58:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__657 (Shuffle)
[08/16/2021-04:58:03] [V] [TRT] Tactic: 0 time 0.0417
[08/16/2021-04:58:03] [V] [TRT] Tactic: 1 time 0.1309
[08/16/2021-04:58:03] [V] [TRT] Fastest Tactic: 0 Time: 0.0417
[08/16/2021-04:58:03] [V] [TRT] *************** Autotuning format combination: Half(1) -> Half(1,130944) ***************
[08/16/2021-04:58:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__657 (Shuffle)
[08/16/2021-04:58:03] [V] [TRT] Tactic: 0 time 0.025844
[08/16/2021-04:58:03] [V] [TRT] Tactic: 1 time 0.117412
[08/16/2021-04:58:03] [V] [TRT] Fastest Tactic: 0 Time: 0.025844
[08/16/2021-04:58:03] [V] [TRT] *************** Autotuning format combination: Float(1), Float(1) -> Float(1) ***************
[08/16/2021-04:58:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/add_3 (ElementWise)
[08/16/2021-04:58:03] [V] [TRT] Tactic: 1 time 0.054048
[08/16/2021-04:58:03] [V] [TRT] Tactic: 2 time 0.071272
[08/16/2021-04:58:03] [V] [TRT] Fastest Tactic: 1 Time: 0.054048
[08/16/2021-04:58:03] [V] [TRT] *************** Autotuning format combination: Half(1), Half(1) -> Half(1) ***************
[08/16/2021-04:58:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/add_3 (ElementWise)
[08/16/2021-04:58:03] [V] [TRT] Tactic: 1 time 0.03434
[08/16/2021-04:58:03] [V] [TRT] Tactic: 2 time 0.044948
[08/16/2021-04:58:03] [V] [TRT] Fastest Tactic: 1 Time: 0.03434
[08/16/2021-04:58:03] [V] [TRT] *************** Autotuning format combination: Float(1) -> Float(1,130944) ***************
[08/16/2021-04:58:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__659 (Shuffle)
[08/16/2021-04:58:03] [V] [TRT] Tactic: 0 time 0.041656
[08/16/2021-04:58:03] [V] [TRT] Tactic: 1 time 0.13026
[08/16/2021-04:58:03] [V] [TRT] Fastest Tactic: 0 Time: 0.041656
[08/16/2021-04:58:03] [V] [TRT] *************** Autotuning format combination: Half(1) -> Half(1,130944) ***************
[08/16/2021-04:58:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__659 (Shuffle)
[08/16/2021-04:58:03] [V] [TRT] Tactic: 0 time 0.024952
[08/16/2021-04:58:03] [V] [TRT] Tactic: 1 time 0.118104
[08/16/2021-04:58:03] [V] [TRT] Fastest Tactic: 0 Time: 0.024952
[08/16/2021-04:58:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack (Reformat)
[08/16/2021-04:58:03] [V] [TRT] Tactic: 1002 time 0.065944
[08/16/2021-04:58:03] [V] [TRT] Tactic: 0 time 0.04152
[08/16/2021-04:58:03] [V] [TRT] Fastest Tactic: 0 Time: 0.04152
[08/16/2021-04:58:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack (Reformat)
[08/16/2021-04:58:03] [V] [TRT] Tactic: 1002 time 0.061312
[08/16/2021-04:58:03] [V] [TRT] Tactic: 0 time 0.092564
[08/16/2021-04:58:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.061312
[08/16/2021-04:58:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack (Reformat)
[08/16/2021-04:58:03] [V] [TRT] Tactic: 1002 time 0.0652
[08/16/2021-04:58:03] [V] [TRT] Tactic: 0 time 0.082308
[08/16/2021-04:58:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0652
[08/16/2021-04:58:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack (Reformat)
[08/16/2021-04:58:03] [V] [TRT] Tactic: 1002 time 0.051052
[08/16/2021-04:58:04] [V] [TRT] Tactic: 0 time 0.02348
[08/16/2021-04:58:04] [V] [TRT] Fastest Tactic: 0 Time: 0.02348
[08/16/2021-04:58:04] [V] [TRT] *************** Autotuning format combination: Float(1,130944) -> Float(1) ***************
[08/16/2021-04:58:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack__647 (Shuffle)
[08/16/2021-04:58:04] [V] [TRT] Tactic: 0 time 0.042324
[08/16/2021-04:58:04] [V] [TRT] Tactic: 1 time 0.130696
[08/16/2021-04:58:04] [V] [TRT] Fastest Tactic: 0 Time: 0.042324
[08/16/2021-04:58:04] [V] [TRT] *************** Autotuning format combination: Half(1,130944) -> Half(1) ***************
[08/16/2021-04:58:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack__647 (Shuffle)
[08/16/2021-04:58:04] [V] [TRT] Tactic: 0 time 0.025192
[08/16/2021-04:58:04] [V] [TRT] Tactic: 1 time 0.119184
[08/16/2021-04:58:04] [V] [TRT] Fastest Tactic: 0 Time: 0.025192
[08/16/2021-04:58:04] [V] [TRT] *************** Autotuning format combination:  -> Float(1) ***************
[08/16/2021-04:58:04] [V] [TRT] *************** Autotuning format combination:  -> Half(1) ***************
[08/16/2021-04:58:04] [V] [TRT] *************** Autotuning format combination:  -> Float(1) ***************
[08/16/2021-04:58:04] [V] [TRT] *************** Autotuning format combination:  -> Half(1) ***************
[08/16/2021-04:58:04] [V] [TRT] *************** Autotuning format combination: Float(1), Float(1), Float(1) -> Float(1) ***************
[08/16/2021-04:58:04] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN((Unnamed Layer* 305) [Constant] + (Unnamed Layer* 306) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv), StatefulPartitionedCall/Postprocessor/Decode/mul_2), StatefulPartitionedCall/Postprocessor/Decode/add) (PointWise)
[08/16/2021-04:58:04] [V] [TRT] Tactic: 128 time 0.12078
[08/16/2021-04:58:04] [V] [TRT] Tactic: 256 time 0.121244
[08/16/2021-04:58:04] [V] [TRT] Tactic: 512 time 0.121488
[08/16/2021-04:58:04] [V] [TRT] Tactic: -32 time 0.180384
[08/16/2021-04:58:04] [V] [TRT] Tactic: -64 time 0.163292
[08/16/2021-04:58:04] [V] [TRT] Tactic: -128 time 0.145704
[08/16/2021-04:58:04] [V] [TRT] Fastest Tactic: 128 Time: 0.12078
[08/16/2021-04:58:04] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN((Unnamed Layer* 305) [Constant] + (Unnamed Layer* 306) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv), StatefulPartitionedCall/Postprocessor/Decode/mul_2), StatefulPartitionedCall/Postprocessor/Decode/add) (PointWiseV2)
[08/16/2021-04:58:04] [V] [TRT] Tactic: 0 time 0.067908
[08/16/2021-04:58:04] [V] [TRT] Tactic: 1 time 0.067768
[08/16/2021-04:58:04] [V] [TRT] Tactic: 2 time 0.068984
[08/16/2021-04:58:04] [V] [TRT] Tactic: 3 time 0.06922
[08/16/2021-04:58:04] [V] [TRT] Tactic: 4 time 0.067716
[08/16/2021-04:58:04] [V] [TRT] Tactic: 5 time 0.072488
[08/16/2021-04:58:04] [V] [TRT] Tactic: 6 time 0.068996
[08/16/2021-04:58:04] [V] [TRT] Tactic: 7 time 0.0694
[08/16/2021-04:58:04] [V] [TRT] Tactic: 8 time 0.0695
[08/16/2021-04:58:04] [V] [TRT] Tactic: 9 time 0.075036
[08/16/2021-04:58:04] [V] [TRT] Tactic: 28 time 0.067556
[08/16/2021-04:58:04] [V] [TRT] Fastest Tactic: 28 Time: 0.067556
[08/16/2021-04:58:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28
[08/16/2021-04:58:04] [V] [TRT] 
[08/16/2021-04:58:04] [V] [TRT] *************** Autotuning format combination: Half(1), Half(1), Half(1) -> Half(1) ***************
[08/16/2021-04:58:04] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN((Unnamed Layer* 305) [Constant] + (Unnamed Layer* 306) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv), StatefulPartitionedCall/Postprocessor/Decode/mul_2), StatefulPartitionedCall/Postprocessor/Decode/add) (PointWise)
[08/16/2021-04:58:04] [V] [TRT] Tactic: 128 time 0.131168
[08/16/2021-04:58:04] [V] [TRT] Tactic: 256 time 0.125152
[08/16/2021-04:58:04] [V] [TRT] Tactic: 512 time 0.126836
[08/16/2021-04:58:04] [V] [TRT] Tactic: -32 time 0.195792
[08/16/2021-04:58:04] [V] [TRT] Tactic: -64 time 0.18888
[08/16/2021-04:58:04] [V] [TRT] Tactic: -128 time 0.15616
[08/16/2021-04:58:04] [V] [TRT] Fastest Tactic: 256 Time: 0.125152
[08/16/2021-04:58:04] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN((Unnamed Layer* 305) [Constant] + (Unnamed Layer* 306) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv), StatefulPartitionedCall/Postprocessor/Decode/mul_2), StatefulPartitionedCall/Postprocessor/Decode/add) (PointWiseV2)
[08/16/2021-04:58:04] [V] [TRT] Tactic: 0 time 0.05262
[08/16/2021-04:58:04] [V] [TRT] Tactic: 1 time 0.0449
[08/16/2021-04:58:04] [V] [TRT] Tactic: 2 time 0.041196
[08/16/2021-04:58:04] [V] [TRT] Tactic: 3 time 0.043788
[08/16/2021-04:58:04] [V] [TRT] Tactic: 4 time 0.043292
[08/16/2021-04:58:04] [V] [TRT] Tactic: 5 time 0.042524
[08/16/2021-04:58:04] [V] [TRT] Tactic: 6 time 0.047456
[08/16/2021-04:58:04] [V] [TRT] Tactic: 7 time 0.043696
[08/16/2021-04:58:04] [V] [TRT] Tactic: 8 time 0.043112
[08/16/2021-04:58:04] [V] [TRT] Tactic: 9 time 0.043516
[08/16/2021-04:58:04] [V] [TRT] Tactic: 28 time 0.052324
[08/16/2021-04:58:04] [V] [TRT] Fastest Tactic: 2 Time: 0.041196
[08/16/2021-04:58:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2
[08/16/2021-04:58:04] [V] [TRT] 
[08/16/2021-04:58:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack_2 (Reformat)
[08/16/2021-04:58:04] [V] [TRT] Tactic: 1002 time 0.066464
[08/16/2021-04:58:04] [V] [TRT] Tactic: 0 time 0.041384
[08/16/2021-04:58:04] [V] [TRT] Fastest Tactic: 0 Time: 0.041384
[08/16/2021-04:58:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack_2 (Reformat)
[08/16/2021-04:58:04] [V] [TRT] Tactic: 1002 time 0.061288
[08/16/2021-04:58:04] [V] [TRT] Tactic: 0 time 0.092696
[08/16/2021-04:58:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.061288
[08/16/2021-04:58:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack_2 (Reformat)
[08/16/2021-04:58:04] [V] [TRT] Tactic: 1002 time 0.064964
[08/16/2021-04:58:04] [V] [TRT] Tactic: 0 time 0.083248
[08/16/2021-04:58:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.064964
[08/16/2021-04:58:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack_2 (Reformat)
[08/16/2021-04:58:04] [V] [TRT] Tactic: 1002 time 0.059924
[08/16/2021-04:58:04] [V] [TRT] Tactic: 0 time 0.025828
[08/16/2021-04:58:04] [V] [TRT] Fastest Tactic: 0 Time: 0.025828
[08/16/2021-04:58:04] [V] [TRT] *************** Autotuning format combination: Float(1,130944) -> Float(1) ***************
[08/16/2021-04:58:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack__649 (Shuffle)
[08/16/2021-04:58:04] [V] [TRT] Tactic: 0 time 0.041336
[08/16/2021-04:58:04] [V] [TRT] Tactic: 1 time 0.128908
[08/16/2021-04:58:04] [V] [TRT] Fastest Tactic: 0 Time: 0.041336
[08/16/2021-04:58:04] [V] [TRT] *************** Autotuning format combination: Half(1,130944) -> Half(1) ***************
[08/16/2021-04:58:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/unstack__649 (Shuffle)
[08/16/2021-04:58:04] [V] [TRT] Tactic: 0 time 0.02546
[08/16/2021-04:58:04] [V] [TRT] Tactic: 1 time 0.11942
[08/16/2021-04:58:04] [V] [TRT] Fastest Tactic: 0 Time: 0.02546
[08/16/2021-04:58:04] [V] [TRT] *************** Autotuning format combination:  -> Float(1) ***************
[08/16/2021-04:58:04] [V] [TRT] *************** Autotuning format combination:  -> Half(1) ***************
[08/16/2021-04:58:04] [V] [TRT] *************** Autotuning format combination: Float(1), Float(1) -> Float(1) ***************
[08/16/2021-04:58:04] [V] [TRT] --------------- Timing Runner: PWN((Unnamed Layer* 325) [Constant] + (Unnamed Layer* 326) [Shuffle], PWN(PWN(PWN(PWN((Unnamed Layer* 299) [Constant] + (Unnamed Layer* 300) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_2), StatefulPartitionedCall/Postprocessor/Decode/Exp_1), StatefulPartitionedCall/Postprocessor/Decode/mul_1), StatefulPartitionedCall/Postprocessor/Decode/truediv_6)) (PointWise)
[08/16/2021-04:58:04] [V] [TRT] Tactic: 128 time 0.14172
[08/16/2021-04:58:04] [V] [TRT] Tactic: 256 time 0.1416
[08/16/2021-04:58:04] [V] [TRT] Tactic: 512 time 0.14194
[08/16/2021-04:58:04] [V] [TRT] Tactic: -32 time 0.20864
[08/16/2021-04:58:04] [V] [TRT] Tactic: -64 time 0.196268
[08/16/2021-04:58:04] [V] [TRT] Tactic: -128 time 0.169172
[08/16/2021-04:58:04] [V] [TRT] Fastest Tactic: 256 Time: 0.1416
[08/16/2021-04:58:04] [V] [TRT] --------------- Timing Runner: PWN((Unnamed Layer* 325) [Constant] + (Unnamed Layer* 326) [Shuffle], PWN(PWN(PWN(PWN((Unnamed Layer* 299) [Constant] + (Unnamed Layer* 300) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_2), StatefulPartitionedCall/Postprocessor/Decode/Exp_1), StatefulPartitionedCall/Postprocessor/Decode/mul_1), StatefulPartitionedCall/Postprocessor/Decode/truediv_6)) (PointWiseV2)
[08/16/2021-04:58:04] [V] [TRT] Tactic: 0 time 0.0544
[08/16/2021-04:58:04] [V] [TRT] Tactic: 1 time 0.053668
[08/16/2021-04:58:04] [V] [TRT] Tactic: 2 time 0.055664
[08/16/2021-04:58:04] [V] [TRT] Tactic: 3 time 0.054824
[08/16/2021-04:58:04] [V] [TRT] Tactic: 4 time 0.05472
[08/16/2021-04:58:04] [V] [TRT] Tactic: 5 time 0.056936
[08/16/2021-04:58:04] [V] [TRT] Tactic: 6 time 0.05726
[08/16/2021-04:58:04] [V] [TRT] Tactic: 7 time 0.05404
[08/16/2021-04:58:04] [V] [TRT] Tactic: 8 time 0.05476
[08/16/2021-04:58:04] [V] [TRT] Tactic: 9 time 0.05688
[08/16/2021-04:58:04] [V] [TRT] Tactic: 28 time 0.054448
[08/16/2021-04:58:04] [V] [TRT] Fastest Tactic: 1 Time: 0.053668
[08/16/2021-04:58:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1
[08/16/2021-04:58:04] [V] [TRT] 
[08/16/2021-04:58:04] [V] [TRT] *************** Autotuning format combination: Half(1), Half(1) -> Half(1) ***************
[08/16/2021-04:58:04] [V] [TRT] --------------- Timing Runner: PWN((Unnamed Layer* 325) [Constant] + (Unnamed Layer* 326) [Shuffle], PWN(PWN(PWN(PWN((Unnamed Layer* 299) [Constant] + (Unnamed Layer* 300) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_2), StatefulPartitionedCall/Postprocessor/Decode/Exp_1), StatefulPartitionedCall/Postprocessor/Decode/mul_1), StatefulPartitionedCall/Postprocessor/Decode/truediv_6)) (PointWise)
[08/16/2021-04:58:04] [V] [TRT] Tactic: 128 time 0.173212
[08/16/2021-04:58:04] [V] [TRT] Tactic: 256 time 0.152492
[08/16/2021-04:58:04] [V] [TRT] Tactic: 512 time 0.143816
[08/16/2021-04:58:04] [V] [TRT] Tactic: -32 time 0.214928
[08/16/2021-04:58:04] [V] [TRT] Tactic: -64 time 0.203152
[08/16/2021-04:58:04] [V] [TRT] Tactic: -128 time 0.172296
[08/16/2021-04:58:04] [V] [TRT] Fastest Tactic: 512 Time: 0.143816
[08/16/2021-04:58:04] [V] [TRT] --------------- Timing Runner: PWN((Unnamed Layer* 325) [Constant] + (Unnamed Layer* 326) [Shuffle], PWN(PWN(PWN(PWN((Unnamed Layer* 299) [Constant] + (Unnamed Layer* 300) [Shuffle], StatefulPartitionedCall/Postprocessor/Decode/truediv_2), StatefulPartitionedCall/Postprocessor/Decode/Exp_1), StatefulPartitionedCall/Postprocessor/Decode/mul_1), StatefulPartitionedCall/Postprocessor/Decode/truediv_6)) (PointWiseV2)
[08/16/2021-04:58:04] [V] [TRT] Tactic: 0 time 0.049804
[08/16/2021-04:58:04] [V] [TRT] Tactic: 1 time 0.042596
[08/16/2021-04:58:04] [V] [TRT] Tactic: 2 time 0.03682
[08/16/2021-04:58:04] [V] [TRT] Tactic: 3 time 0.040076
[08/16/2021-04:58:04] [V] [TRT] Tactic: 4 time 0.03594
[08/16/2021-04:58:04] [V] [TRT] Tactic: 5 time 0.034788
[08/16/2021-04:58:04] [V] [TRT] Tactic: 6 time 0.041688
[08/16/2021-04:58:04] [V] [TRT] Tactic: 7 time 0.036768
[08/16/2021-04:58:04] [V] [TRT] Tactic: 8 time 0.035976
[08/16/2021-04:58:04] [V] [TRT] Tactic: 9 time 0.03648
[08/16/2021-04:58:04] [V] [TRT] Tactic: 28 time 0.048416
[08/16/2021-04:58:04] [V] [TRT] Fastest Tactic: 5 Time: 0.034788
[08/16/2021-04:58:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5
[08/16/2021-04:58:05] [V] [TRT] 
[08/16/2021-04:58:05] [V] [TRT] *************** Autotuning format combination: Float(1), Float(1) -> Float(1) ***************
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/sub (ElementWise)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1 time 0.054388
[08/16/2021-04:58:05] [V] [TRT] Tactic: 2 time 0.07182
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 1 Time: 0.054388
[08/16/2021-04:58:05] [V] [TRT] *************** Autotuning format combination: Half(1), Half(1) -> Half(1) ***************
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/sub (ElementWise)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1 time 0.034932
[08/16/2021-04:58:05] [V] [TRT] Tactic: 2 time 0.044792
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 1 Time: 0.034932
[08/16/2021-04:58:05] [V] [TRT] *************** Autotuning format combination: Float(1) -> Float(1,130944) ***************
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__656 (Shuffle)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.042132
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1 time 0.131156
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.042132
[08/16/2021-04:58:05] [V] [TRT] *************** Autotuning format combination: Half(1) -> Half(1,130944) ***************
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__656 (Shuffle)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.025252
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1 time 0.11872
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.025252
[08/16/2021-04:58:05] [V] [TRT] *************** Autotuning format combination: Float(1), Float(1) -> Float(1) ***************
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/add_2 (ElementWise)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1 time 0.05392
[08/16/2021-04:58:05] [V] [TRT] Tactic: 2 time 0.071392
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 1 Time: 0.05392
[08/16/2021-04:58:05] [V] [TRT] *************** Autotuning format combination: Half(1), Half(1) -> Half(1) ***************
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/add_2 (ElementWise)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1 time 0.03444
[08/16/2021-04:58:05] [V] [TRT] Tactic: 2 time 0.045324
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 1 Time: 0.03444
[08/16/2021-04:58:05] [V] [TRT] *************** Autotuning format combination: Float(1) -> Float(1,130944) ***************
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__658 (Shuffle)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.041852
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1 time 0.13042
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.041852
[08/16/2021-04:58:05] [V] [TRT] *************** Autotuning format combination: Half(1) -> Half(1,130944) ***************
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__658 (Shuffle)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.025216
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1 time 0.11906
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.025216
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__656:0 copy (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 0.079688
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.04174
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.04174
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__656:0 copy (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 0.077024
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.05962
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.05962
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__656:0 copy (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 0.077192
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.058924
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.058924
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__656:0 copy (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 0.071296
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.025056
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.025056
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__657:0 copy (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 0.078368
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.041128
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.041128
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__657:0 copy (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 0.076752
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.058632
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.058632
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__657:0 copy (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 0.077664
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.058744
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.058744
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__657:0 copy (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 0.073332
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.024984
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.024984
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__658:0 copy (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 0.078868
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.041452
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.041452
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__658:0 copy (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 0.07704
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.0588
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.0588
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__658:0 copy (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 0.077072
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.058884
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.058884
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__658:0 copy (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 0.073284
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.026228
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.026228
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__659:0 copy (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 0.078768
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.04138
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.04138
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__659:0 copy (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 0.07692
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.0585
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.0585
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__659:0 copy (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 0.078204
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.059004
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.059004
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/stack_Unsqueeze__659:0 copy (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 0.064712
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.0231
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.0231
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 0.23238
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.308984
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.23238
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 0.241536
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.293168
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.241536
[08/16/2021-04:58:05] [V] [TRT] *************** Autotuning format combination: Float(1,130944) -> Float(1,4,4,523776) ***************
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/transpose_1 + StatefulPartitionedCall/Postprocessor/Reshape_2 + StatefulPartitionedCall/Postprocessor/ExpandDims_1 (Shuffle)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.194528
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1 time 1.17704
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.194528
[08/16/2021-04:58:05] [V] [TRT] *************** Autotuning format combination: Half(1,130944) -> Half(1,4,4,523776) ***************
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/Postprocessor/Decode/transpose_1 + StatefulPartitionedCall/Postprocessor/Reshape_2 + StatefulPartitionedCall/Postprocessor/ExpandDims_1 (Shuffle)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.187108
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1 time 1.30006
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.187108
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 3.15111
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.188096
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.188096
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 0.192992
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.210028
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.192992
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 2.6936
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.09548
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.09548
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:05] [V] [TRT] Tactic: 1002 time 2.68882
[08/16/2021-04:58:05] [V] [TRT] Tactic: 0 time 0.89132
[08/16/2021-04:58:05] [V] [TRT] Fastest Tactic: 0 Time: 0.89132
[08/16/2021-04:58:05] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:06] [V] [TRT] Tactic: 1002 time 12.2117
[08/16/2021-04:58:06] [V] [TRT] Tactic: 0 time 0.09898
[08/16/2021-04:58:06] [V] [TRT] Fastest Tactic: 0 Time: 0.09898
[08/16/2021-04:58:06] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:06] [V] [TRT] Tactic: 1002 time 10.4021
[08/16/2021-04:58:06] [V] [TRT] Tactic: 0 time 0.091744
[08/16/2021-04:58:06] [V] [TRT] Fastest Tactic: 0 Time: 0.091744
[08/16/2021-04:58:06] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:06] [V] [TRT] Tactic: 1002 time 1.46688
[08/16/2021-04:58:06] [V] [TRT] Tactic: 0 time 0.11322
[08/16/2021-04:58:06] [V] [TRT] Fastest Tactic: 0 Time: 0.11322
[08/16/2021-04:58:06] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:06] [V] [TRT] Tactic: 1002 time 1.47092
[08/16/2021-04:58:06] [V] [TRT] Tactic: 0 time 0.113488
[08/16/2021-04:58:06] [V] [TRT] Fastest Tactic: 0 Time: 0.113488
[08/16/2021-04:58:06] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:06] [V] [TRT] Tactic: 1002 time 0.140204
[08/16/2021-04:58:06] [V] [TRT] Tactic: 0 time 0.109732
[08/16/2021-04:58:06] [V] [TRT] Fastest Tactic: 0 Time: 0.109732
[08/16/2021-04:58:06] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:06] [V] [TRT] Tactic: 1002 time 1.47799
[08/16/2021-04:58:06] [V] [TRT] Tactic: 0 time 0.09376
[08/16/2021-04:58:06] [V] [TRT] Fastest Tactic: 0 Time: 0.09376
[08/16/2021-04:58:06] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:06] [V] [TRT] Tactic: 1002 time 1.48005
[08/16/2021-04:58:06] [V] [TRT] Tactic: 0 time 0.059788
[08/16/2021-04:58:06] [V] [TRT] Fastest Tactic: 0 Time: 0.059788
[08/16/2021-04:58:06] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:06] [V] [TRT] Tactic: 1002 time 1.47994
[08/16/2021-04:58:06] [V] [TRT] Tactic: 0 time 0.49774
[08/16/2021-04:58:06] [V] [TRT] Fastest Tactic: 0 Time: 0.49774
[08/16/2021-04:58:06] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:06] [V] [TRT] Tactic: 1002 time 10.4463
[08/16/2021-04:58:06] [V] [TRT] Tactic: 0 time 0.080128
[08/16/2021-04:58:06] [V] [TRT] Fastest Tactic: 0 Time: 0.080128
[08/16/2021-04:58:06] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:06] [V] [TRT] Tactic: 1002 time 1.47562
[08/16/2021-04:58:06] [V] [TRT] Tactic: 0 time 0.113848
[08/16/2021-04:58:06] [V] [TRT] Fastest Tactic: 0 Time: 0.113848
[08/16/2021-04:58:06] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:06] [V] [TRT] Tactic: 1002 time 10.4351
[08/16/2021-04:58:06] [V] [TRT] Tactic: 0 time 0.058448
[08/16/2021-04:58:06] [V] [TRT] Fastest Tactic: 0 Time: 0.058448
[08/16/2021-04:58:06] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:06] [V] [TRT] Tactic: 1002 time 1.4771
[08/16/2021-04:58:06] [V] [TRT] Tactic: 0 time 0.247696
[08/16/2021-04:58:06] [V] [TRT] Fastest Tactic: 0 Time: 0.247696
[08/16/2021-04:58:06] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:06] [V] [TRT] Tactic: 1002 time 1.08069
[08/16/2021-04:58:06] [V] [TRT] Tactic: 0 time 0.295172
[08/16/2021-04:58:06] [V] [TRT] Fastest Tactic: 0 Time: 0.295172
[08/16/2021-04:58:06] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:06] [V] [TRT] Tactic: 1002 time 1.46252
[08/16/2021-04:58:06] [V] [TRT] Tactic: 0 time 0.114008
[08/16/2021-04:58:06] [V] [TRT] Fastest Tactic: 0 Time: 0.114008
[08/16/2021-04:58:06] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:06] [V] [TRT] Tactic: 1002 time 1.08767
[08/16/2021-04:58:07] [V] [TRT] Tactic: 0 time 0.286016
[08/16/2021-04:58:07] [V] [TRT] Fastest Tactic: 0 Time: 0.286016
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[08/16/2021-04:58:07] [V] [TRT] Tactic: 1002 time 1.46686
[08/16/2021-04:58:07] [V] [TRT] Tactic: 0 time 0.256108
[08/16/2021-04:58:07] [V] [TRT] Fastest Tactic: 0 Time: 0.256108
[08/16/2021-04:58:07] [V] [TRT] *************** Autotuning format combination: Float(1,4,4,523776) -> Float(1,4,4,523776) ***************
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:07] [V] [TRT] Tactic: 1002 time 0.145164
[08/16/2021-04:58:07] [V] [TRT] Tactic: 0 time 0.099552
[08/16/2021-04:58:07] [V] [TRT] Fastest Tactic: 0 Time: 0.099552
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:07] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:07] [V] [TRT] 
[08/16/2021-04:58:07] [V] [TRT] *************** Autotuning format combination: Float(1,4,4,523776) -> Float(1,4,4:32,16368) ***************
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:07] [V] [TRT] Tactic: 1002 time 1.47367
[08/16/2021-04:58:07] [V] [TRT] Tactic: 0 time 0.099468
[08/16/2021-04:58:07] [V] [TRT] Fastest Tactic: 0 Time: 0.099468
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:07] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:07] [V] [TRT] 
[08/16/2021-04:58:07] [V] [TRT] *************** Autotuning format combination: Float(1,4,4,523776) -> Half(1,4,4,523776) ***************
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:07] [V] [TRT] Tactic: 1002 time 0.131256
[08/16/2021-04:58:07] [V] [TRT] Tactic: 0 time 0.116552
[08/16/2021-04:58:07] [V] [TRT] Fastest Tactic: 0 Time: 0.116552
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:07] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:07] [V] [TRT] 
[08/16/2021-04:58:07] [V] [TRT] *************** Autotuning format combination: Float(1,4,4,523776) -> Half(1,4,4:2,261888) ***************
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:07] [V] [TRT] Tactic: 1002 time 1.47356
[08/16/2021-04:58:07] [V] [TRT] Tactic: 0 time 0.073856
[08/16/2021-04:58:07] [V] [TRT] Fastest Tactic: 0 Time: 0.073856
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:07] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:07] [V] [TRT] 
[08/16/2021-04:58:07] [V] [TRT] *************** Autotuning format combination: Float(1,4,4,523776) -> Half(16368,65472,1:8,65472) ***************
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:07] [V] [TRT] Tactic: 1002 time 1.47517
[08/16/2021-04:58:07] [V] [TRT] Tactic: 0 time 0.482784
[08/16/2021-04:58:07] [V] [TRT] Fastest Tactic: 0 Time: 0.482784
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:07] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:07] [V] [TRT] 
[08/16/2021-04:58:07] [V] [TRT] *************** Autotuning format combination: Float(1,4,4:32,16368) -> Float(1,4,4,523776) ***************
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:07] [V] [TRT] Tactic: 1002 time 10.387
[08/16/2021-04:58:07] [V] [TRT] Tactic: 0 time 0.096764
[08/16/2021-04:58:07] [V] [TRT] Fastest Tactic: 0 Time: 0.096764
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:07] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:07] [V] [TRT] 
[08/16/2021-04:58:07] [V] [TRT] *************** Autotuning format combination: Float(1,4,4:32,16368) -> Float(1,4,4:32,16368) ***************
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:07] [V] [TRT] Tactic: 1002 time 1.46508
[08/16/2021-04:58:07] [V] [TRT] Tactic: 0 time 0.099276
[08/16/2021-04:58:07] [V] [TRT] Fastest Tactic: 0 Time: 0.099276
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:07] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:07] [V] [TRT] 
[08/16/2021-04:58:07] [V] [TRT] *************** Autotuning format combination: Float(1,4,4:32,16368) -> Half(1,4,4,523776) ***************
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:07] [V] [TRT] Tactic: 1002 time 10.4044
[08/16/2021-04:58:07] [V] [TRT] Tactic: 0 time 0.091992
[08/16/2021-04:58:07] [V] [TRT] Fastest Tactic: 0 Time: 0.091992
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:07] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:07] [V] [TRT] 
[08/16/2021-04:58:07] [V] [TRT] *************** Autotuning format combination: Float(1,4,4:32,16368) -> Half(1,4,4:2,261888) ***************
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:07] [V] [TRT] Tactic: 1002 time 1.4707
[08/16/2021-04:58:07] [V] [TRT] Tactic: 0 time 0.113212
[08/16/2021-04:58:07] [V] [TRT] Fastest Tactic: 0 Time: 0.113212
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:07] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:07] [V] [TRT] 
[08/16/2021-04:58:07] [V] [TRT] *************** Autotuning format combination: Float(1,4,4:32,16368) -> Half(16368,65472,1:8,65472) ***************
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:07] [V] [TRT] Tactic: 1002 time 1.47083
[08/16/2021-04:58:07] [V] [TRT] Tactic: 0 time 0.113572
[08/16/2021-04:58:07] [V] [TRT] Fastest Tactic: 0 Time: 0.113572
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:07] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:07] [V] [TRT] 
[08/16/2021-04:58:07] [V] [TRT] *************** Autotuning format combination: Half(1,4,4,523776) -> Float(1,4,4,523776) ***************
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:07] [V] [TRT] Tactic: 1002 time 0.14194
[08/16/2021-04:58:07] [V] [TRT] Tactic: 0 time 0.110484
[08/16/2021-04:58:07] [V] [TRT] Fastest Tactic: 0 Time: 0.110484
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:07] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:07] [V] [TRT] 
[08/16/2021-04:58:07] [V] [TRT] *************** Autotuning format combination: Half(1,4,4,523776) -> Float(1,4,4:32,16368) ***************
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:07] [V] [TRT] Tactic: 1002 time 1.47525
[08/16/2021-04:58:07] [V] [TRT] Tactic: 0 time 0.093596
[08/16/2021-04:58:07] [V] [TRT] Fastest Tactic: 0 Time: 0.093596
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:07] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:07] [V] [TRT] 
[08/16/2021-04:58:07] [V] [TRT] *************** Autotuning format combination: Half(1,4,4,523776) -> Half(1,4,4,523776) ***************
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:07] [V] [TRT] Tactic: 1002 time 0.129048
[08/16/2021-04:58:07] [V] [TRT] Tactic: 0 time 0.049804
[08/16/2021-04:58:07] [V] [TRT] Fastest Tactic: 0 Time: 0.049804
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:07] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:07] [V] [TRT] 
[08/16/2021-04:58:07] [V] [TRT] *************** Autotuning format combination: Half(1,4,4,523776) -> Half(1,4,4:2,261888) ***************
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:07] [V] [TRT] Tactic: 1002 time 1.47914
[08/16/2021-04:58:07] [V] [TRT] Tactic: 0 time 0.060024
[08/16/2021-04:58:07] [V] [TRT] Fastest Tactic: 0 Time: 0.060024
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:07] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:07] [V] [TRT] 
[08/16/2021-04:58:07] [V] [TRT] *************** Autotuning format combination: Half(1,4,4,523776) -> Half(16368,65472,1:8,65472) ***************
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:07] [V] [TRT] Tactic: 1002 time 1.48082
[08/16/2021-04:58:07] [V] [TRT] Tactic: 0 time 0.498004
[08/16/2021-04:58:07] [V] [TRT] Fastest Tactic: 0 Time: 0.498004
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:07] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:07] [V] [TRT] 
[08/16/2021-04:58:07] [V] [TRT] *************** Autotuning format combination: Half(1,4,4:2,261888) -> Float(1,4,4,523776) ***************
[08/16/2021-04:58:07] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:08] [V] [TRT] Tactic: 1002 time 10.4628
[08/16/2021-04:58:08] [V] [TRT] Tactic: 0 time 0.079712
[08/16/2021-04:58:08] [V] [TRT] Fastest Tactic: 0 Time: 0.079712
[08/16/2021-04:58:08] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:08] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:08] [V] [TRT] 
[08/16/2021-04:58:08] [V] [TRT] *************** Autotuning format combination: Half(1,4,4:2,261888) -> Float(1,4,4:32,16368) ***************
[08/16/2021-04:58:08] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:08] [V] [TRT] Tactic: 1002 time 1.47691
[08/16/2021-04:58:08] [V] [TRT] Tactic: 0 time 0.113456
[08/16/2021-04:58:08] [V] [TRT] Fastest Tactic: 0 Time: 0.113456
[08/16/2021-04:58:08] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:08] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:08] [V] [TRT] 
[08/16/2021-04:58:08] [V] [TRT] *************** Autotuning format combination: Half(1,4,4:2,261888) -> Half(1,4,4,523776) ***************
[08/16/2021-04:58:08] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:08] [V] [TRT] Tactic: 1002 time 10.4028
[08/16/2021-04:58:08] [V] [TRT] Tactic: 0 time 0.0585
[08/16/2021-04:58:08] [V] [TRT] Fastest Tactic: 0 Time: 0.0585
[08/16/2021-04:58:08] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:08] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:08] [V] [TRT] 
[08/16/2021-04:58:08] [V] [TRT] *************** Autotuning format combination: Half(1,4,4:2,261888) -> Half(1,4,4:2,261888) ***************
[08/16/2021-04:58:08] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:08] [V] [TRT] Tactic: 1002 time 1.48011
[08/16/2021-04:58:08] [V] [TRT] Tactic: 0 time 0.049132
[08/16/2021-04:58:08] [V] [TRT] Fastest Tactic: 0 Time: 0.049132
[08/16/2021-04:58:08] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:08] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:08] [V] [TRT] 
[08/16/2021-04:58:08] [V] [TRT] *************** Autotuning format combination: Half(1,4,4:2,261888) -> Half(16368,65472,1:8,65472) ***************
[08/16/2021-04:58:08] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:08] [V] [TRT] Tactic: 1002 time 1.48075
[08/16/2021-04:58:08] [V] [TRT] Tactic: 0 time 0.247892
[08/16/2021-04:58:08] [V] [TRT] Fastest Tactic: 0 Time: 0.247892
[08/16/2021-04:58:08] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:08] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:08] [V] [TRT] 
[08/16/2021-04:58:08] [V] [TRT] *************** Autotuning format combination: Half(16368,65472,1:8,65472) -> Float(1,4,4,523776) ***************
[08/16/2021-04:58:08] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:08] [V] [TRT] Tactic: 1002 time 1.0808
[08/16/2021-04:58:08] [V] [TRT] Tactic: 0 time 0.295128
[08/16/2021-04:58:08] [V] [TRT] Fastest Tactic: 0 Time: 0.295128
[08/16/2021-04:58:08] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:08] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:08] [V] [TRT] 
[08/16/2021-04:58:08] [V] [TRT] *************** Autotuning format combination: Half(16368,65472,1:8,65472) -> Float(1,4,4:32,16368) ***************
[08/16/2021-04:58:08] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:08] [V] [TRT] Tactic: 1002 time 1.46371
[08/16/2021-04:58:08] [V] [TRT] Tactic: 0 time 0.113968
[08/16/2021-04:58:08] [V] [TRT] Fastest Tactic: 0 Time: 0.113968
[08/16/2021-04:58:08] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:08] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:08] [V] [TRT] 
[08/16/2021-04:58:08] [V] [TRT] *************** Autotuning format combination: Half(16368,65472,1:8,65472) -> Half(1,4,4,523776) ***************
[08/16/2021-04:58:08] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:08] [V] [TRT] Tactic: 1002 time 1.08818
[08/16/2021-04:58:08] [V] [TRT] Tactic: 0 time 0.285788
[08/16/2021-04:58:08] [V] [TRT] Fastest Tactic: 0 Time: 0.285788
[08/16/2021-04:58:08] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:08] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:08] [V] [TRT] 
[08/16/2021-04:58:08] [V] [TRT] *************** Autotuning format combination: Half(16368,65472,1:8,65472) -> Half(1,4,4:2,261888) ***************
[08/16/2021-04:58:08] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:08] [V] [TRT] Tactic: 1002 time 1.46639
[08/16/2021-04:58:08] [V] [TRT] Tactic: 0 time 0.254984
[08/16/2021-04:58:08] [V] [TRT] Fastest Tactic: 0 Time: 0.254984
[08/16/2021-04:58:08] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:08] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:08] [V] [TRT] 
[08/16/2021-04:58:08] [V] [TRT] *************** Autotuning format combination: Half(16368,65472,1:8,65472) -> Half(16368,65472,1:8,65472) ***************
[08/16/2021-04:58:08] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Reformat)
[08/16/2021-04:58:08] [V] [TRT] Tactic: 1002 time 0.235472
[08/16/2021-04:58:08] [V] [TRT] Tactic: 0 time 0.049268
[08/16/2021-04:58:08] [V] [TRT] Fastest Tactic: 0 Time: 0.049268
[08/16/2021-04:58:08] [V] [TRT] --------------- Timing Runner: Identity_Out_2 (Cast)
[08/16/2021-04:58:08] [V] [TRT] Cast has no valid tactics for this config, skipping
[08/16/2021-04:58:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[08/16/2021-04:58:08] [V] [TRT] 
[08/16/2021-04:58:08] [V] [TRT] *************** Autotuning format combination: Float(1,4,4,523776), Float(1,91,11915904) -> Int32(1), Float(1,4,400), Float(1,100), Float(1,100) ***************
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/Preprocessor/sub reformatted input 0 (StatefulPartitionedCall/Cast:0) from Float(1,3,1536,786432) to Half(64,192,1:8,98304)
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/Preprocessor/sub reformatted input 1 ((Unnamed Layer* 2) [Shuffle]_output) from Half(1,3,3,3) to Half(1,3,1:8,3)
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 reformatted input 0 (Resize__21:0) from Half(1,1024,1048576,3145728) to Half(1,1024,1:4,1048576)
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/stack_Unsqueeze__508 reformatted input 0 (StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd:0) from Half(32,1024,1:8,32768) to Half(1,32,1024,262144)
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add reformatted input 1 (Transpose__732:0) from Half(1,64,4096,1048576) to Half(32,2048,1:8,131072)
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577 output to be reformatted 0 (StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/stack_Unsqueeze__577:0) from Half(1,64,4096,1048576,1048576) to Half(32,2048,1:8,131072,131072)
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 reformatted input 1 (Transpose__738:0) from Half(1,128,16384,4194304) to Half(32,4096,1:8,524288)
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 output to be reformatted 0 (StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6) from Half(1,8,64:2,16384) to Half(64,512,1:8,4096)
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 reformatted input 0 (StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_3/Relu6:0) from Half(32,512,1:8,8192) to Half(1,16,256:2,32768)
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 reformatted input 0 (StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_4/Relu6:0) from Half(1,8,64:2,8192) to Half(32,256,1:8,2048)
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__359 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2 reformatted input 0 (StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2:0) from Half(69,2208,1:8,70656) to Half(1,32,1024,559104)
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__419 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 reformatted input 0 (StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3:0) from Half(69,1104,1:8,17664) to Half(1,16,256,139776)
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__479 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4 reformatted input 0 (StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4:0) from Half(69,552,1:8,4416) to Half(1,8,64,34944)
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__548 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 reformatted input 0 (StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1:0) from Half(69,4416,1:8,282624) to Half(1,64,4096,2236416)
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__617 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape reformatted input 0 (StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd:0) from Half(69,8832,1:8,1130496) to Half(1,128,16384,8945664)
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__386 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 reformatted input 0 (StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2:0) from Half(3,96,1:8,3072) to Half(1,32,1024,24576)
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__446 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 reformatted input 0 (StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3:0) from Half(1,16,256:2,3072) to Half(1,16,256,6144)
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__506 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 reformatted input 0 (StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4:0) from Half(1,8,64:2,768) to Half(1,8,64,1536)
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__575 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 reformatted input 0 (StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1:0) from Half(3,192,1:8,12288) to Half(1,64,4096,98304)
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__644 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape reformatted input 0 (StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd:0) from Half(3,384,1:8,49152) to Half(1,128,16384,393216)
[08/16/2021-04:58:08] [V] [TRT] Adding reformat layer: Identity_Out_2 reformatted input 0 (StatefulPartitionedCall/Postprocessor/ExpandDims_1:0) from Half(1,4,4,523776) to Float(1,4,4,523776)
[08/16/2021-04:58:08] [V] [TRT] For layer StatefulPartitionedCall/Postprocessor/convert_scores a non-conforming implementation was chosen than was requested i.e. requested layer computation precision and output precision types were ignored because it resulted in faster network performance. Enable strict mode to try force choose a conforming implementation.
[08/16/2021-04:58:08] [V] [TRT] Formats and tactics selection completed in 477.174 seconds.
[08/16/2021-04:58:08] [V] [TRT] After reformat layers: 202 layers
[08/16/2021-04:58:08] [V] [TRT] Block size 47663616
[08/16/2021-04:58:08] [V] [TRT] Block size 47663616
[08/16/2021-04:58:08] [V] [TRT] Block size 33554432
[08/16/2021-04:58:08] [V] [TRT] Block size 16777216
[08/16/2021-04:58:08] [V] [TRT] Block size 8388608
[08/16/2021-04:58:08] [V] [TRT] Block size 4194304
[08/16/2021-04:58:08] [V] [TRT] Block size 2097152
[08/16/2021-04:58:08] [V] [TRT] Block size 1130496
[08/16/2021-04:58:08] [V] [TRT] Block size 282624
[08/16/2021-04:58:08] [V] [TRT] Block size 196608
[08/16/2021-04:58:08] [V] [TRT] Block size 131072
[08/16/2021-04:58:08] [V] [TRT] Block size 49152
[08/16/2021-04:58:08] [V] [TRT] Block size 32768
[08/16/2021-04:58:08] [V] [TRT] Block size 12288
[08/16/2021-04:58:08] [V] [TRT] Block size 3072
[08/16/2021-04:58:08] [V] [TRT] Total Activation Memory: 162177024
[08/16/2021-04:58:08] [I] [TRT] Detected 1 inputs and 4 output network tensors.
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv1_relu/Relu6 () Set Tactic Name: volta_first_layer_filter7x7_fwd
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv2_block3_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block3_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv3_block4_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block3_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block4_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block5_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv4_block6_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_3_conv/Conv2D (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block1_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block2_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_1_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_2_relu/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_add/add + StatefulPartitionedCall/ResNet50V1_FPN/functional_1/conv5_block3_out/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_3/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block5/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_2/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/bottom_up_block6/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_3/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/add_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1_conv/Conv2D + StatefulPartitionedCall/ResNet50V1_FPN/FeatureMaps/top_down/smoothing_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_1/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_4/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_4/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_2/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_0/activation_0/Relu6 || StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_0/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_1/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_3/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_1/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_2/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_2/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/ClassPredictionTower/conv2d_3/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/Conv2D + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/BoxPredictionTower/conv2d_3/activation_0/Relu6 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (h884cudnn) Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:58:08] [V] [TRT] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (h884cudnn) Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1
[08/16/2021-04:58:09] [08/16/2021-04:58:09] [V] [TRT] Builder timing cache: created 923 entries, 1735 hit(s)
[08/16/2021-04:58:09] [08/16/2021-04:58:09] [08/16/2021-04:58:09] &&&& FAILED TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=resnet50-512_unsqueezed_float.onnx --explicitBatch --verbose --fp16