&&&& RUNNING TensorRT.trtexec # TensorRT-7.2.3.4\bin\trtexec.exe --onnx=D:\TensorRT_forum\model.onnx --verbose
[06/29/2021-11:48:21] [I] === Model Options ===
[06/29/2021-11:48:21] [I] Format: ONNX
[06/29/2021-11:48:21] [I] Model: D:\TensorRT_forum\model.onnx
[06/29/2021-11:48:21] [I] Output:
[06/29/2021-11:48:21] [I] === Build Options ===
[06/29/2021-11:48:21] [I] Max batch: explicit
[06/29/2021-11:48:21] [I] Workspace: 16 MiB
[06/29/2021-11:48:21] [I] minTiming: 1
[06/29/2021-11:48:21] [I] avgTiming: 8
[06/29/2021-11:48:21] [I] Precision: FP32
[06/29/2021-11:48:21] [I] Calibration: 
[06/29/2021-11:48:21] [I] Refit: Disabled
[06/29/2021-11:48:21] [I] Safe mode: Disabled
[06/29/2021-11:48:21] [I] Save engine: 
[06/29/2021-11:48:21] [I] Load engine: 
[06/29/2021-11:48:21] [I] Builder Cache: Enabled
[06/29/2021-11:48:21] [I] NVTX verbosity: 0
[06/29/2021-11:48:21] [I] Tactic sources: Using default tactic sources
[06/29/2021-11:48:21] [I] Input(s)s format: fp32:CHW
[06/29/2021-11:48:21] [I] Output(s)s format: fp32:CHW
[06/29/2021-11:48:21] [I] Input build shapes: model
[06/29/2021-11:48:21] [I] Input calibration shapes: model
[06/29/2021-11:48:21] [I] === System Options ===
[06/29/2021-11:48:21] [I] Device: 0
[06/29/2021-11:48:21] [I] DLACore: 
[06/29/2021-11:48:21] [I] Plugins:
[06/29/2021-11:48:21] [I] === Inference Options ===
[06/29/2021-11:48:21] [I] Batch: Explicit
[06/29/2021-11:48:21] [I] Input inference shapes: model
[06/29/2021-11:48:21] [I] Iterations: 10
[06/29/2021-11:48:21] [I] Duration: 3s (+ 200ms warm up)
[06/29/2021-11:48:21] [I] Sleep time: 0ms
[06/29/2021-11:48:21] [I] Streams: 1
[06/29/2021-11:48:21] [I] ExposeDMA: Disabled
[06/29/2021-11:48:21] [I] Data transfers: Enabled
[06/29/2021-11:48:21] [I] Spin-wait: Disabled
[06/29/2021-11:48:21] [I] Multithreading: Disabled
[06/29/2021-11:48:21] [I] CUDA Graph: Disabled
[06/29/2021-11:48:21] [I] Separate profiling: Disabled
[06/29/2021-11:48:21] [I] Skip inference: Disabled
[06/29/2021-11:48:21] [I] Inputs:
[06/29/2021-11:48:21] [I] === Reporting Options ===
[06/29/2021-11:48:21] [I] Verbose: Enabled
[06/29/2021-11:48:21] [I] Averages: 10 inferences
[06/29/2021-11:48:21] [I] Percentile: 99
[06/29/2021-11:48:21] [I] Dump refittable layers:Disabled
[06/29/2021-11:48:21] [I] Dump output: Disabled
[06/29/2021-11:48:21] [I] Profile: Disabled
[06/29/2021-11:48:21] [I] Export timing to JSON file: 
[06/29/2021-11:48:21] [I] Export output to JSON file: 
[06/29/2021-11:48:21] [I] Export profile to JSON file: 
[06/29/2021-11:48:21] [I] 
[06/29/2021-11:48:21] [I] === Device Information ===
[06/29/2021-11:48:21] [I] Selected Device: TITAN RTX
[06/29/2021-11:48:21] [I] Compute Capability: 7.5
[06/29/2021-11:48:21] [I] SMs: 72
[06/29/2021-11:48:21] [I] Compute Clock Rate: 1.77 GHz
[06/29/2021-11:48:21] [I] Device Global Memory: 24576 MiB
[06/29/2021-11:48:21] [I] Shared Memory per SM: 64 KiB
[06/29/2021-11:48:21] [I] Memory Bus Width: 384 bits (ECC disabled)
[06/29/2021-11:48:21] [I] Memory Clock Rate: 7.001 GHz
[06/29/2021-11:48:21] [I] 
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::Region_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::CropAndResize version 1
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::Proposal version 1
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::Split version 1
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1
----------------------------------------------------------------
Input filename:   D:\TensorRT_forum\model.onnx
ONNX IR version:  0.0.4
Opset version:    9
Producer name:    tf2onnx
Producer version: 1.9.0
Domain:           
Model version:    0
Doc string:       
----------------------------------------------------------------
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::Proposal version 1
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::Split version 1
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:202: Adding network input: input_layer with dtype: float32, dimensions: (-1, 112, 112, 3)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: input_layer for ONNX tensor: input_layer
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/predictions/MatMul/ReadVariableOp:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd/ReadVariableOp:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: Conv__435_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:90: Importing initializer: Conv__435_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_conv/Conv2D__7 [Transpose]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: input_layer
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_conv/Conv2D__7 [Transpose] inputs: [input_layer -> (-1, 112, 112, 3)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_conv/Conv2D__7 for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_conv/Conv2D__7
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_conv/Conv2D__7:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_conv/Conv2D__7:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_conv/Conv2D__7 [Transpose] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv1_conv/Conv2D__7:0 -> (-1, 3, 112, 112)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv__435 [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_conv/Conv2D__7:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: Conv__435_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: Conv__435_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: Conv__435 [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv1_conv/Conv2D__7:0 -> (-1, 3, 112, 112)], [Conv__435_weights_fused_bn -> (64, 3, 7, 7)], [Conv__435_bias_fused_bn -> (64)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 3, 112, 112)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv__435 for ONNX node: Conv__435
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (7, 7), strides: (2, 2), prepadding: (3, 3), postpadding: (3, 3), dilations: (1, 1), numOutputs: 64
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 64, 56, 56)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: Conv__435 [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv1_bn/FusedBatchNormV3:0 -> (-1, 64, 56, 56)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv1_bn/FusedBatchNormV3:0 -> (-1, 64, 56, 56)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu:0 -> (-1, 64, 56, 56)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pad/Pad [Pad]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pad/Pad [Pad] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu:0 -> (-1, 64, 56, 56)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pad/Pad for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pad/Pad
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pad/Pad:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pad/Pad:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pad/Pad [Pad] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pad/Pad:0 -> (-1, 64, 58, 58)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pool/MaxPool [MaxPool]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pad/Pad:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pool/MaxPool [MaxPool] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pad/Pad:0 -> (-1, 64, 58, 58)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pool/MaxPool for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pool/MaxPool
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pool/MaxPool:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pool/MaxPool:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pool/MaxPool [MaxPool] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pool/MaxPool:0 -> (-1, 64, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pool/MaxPool:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pool/MaxPool:0 -> (-1, 64, 28, 28)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D_weights_fused_bn -> (64, 64, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D_bias_fused_bn -> (64)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 64, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_bn/FusedBatchNormV3:0 -> (-1, 64, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_bn/FusedBatchNormV3:0 -> (-1, 64, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu:0 -> (-1, 64, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu:0 -> (-1, 64, 28, 28)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D_weights_fused_bn -> (64, 64, 3, 3)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D_bias_fused_bn -> (64)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 64, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_bn/FusedBatchNormV3:0 -> (-1, 64, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_bn/FusedBatchNormV3:0 -> (-1, 64, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu:0 -> (-1, 64, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu:0 -> (-1, 64, 28, 28)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D_weights_fused_bn -> (256, 64, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D_bias_fused_bn -> (256)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 256, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_bn/FusedBatchNormV3:0 -> (-1, 256, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pool/MaxPool:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pool/MaxPool:0 -> (-1, 64, 28, 28)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D_weights_fused_bn -> (256, 64, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D_bias_fused_bn -> (256)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 256, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_bn/FusedBatchNormV3:0 -> (-1, 256, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add [Add]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_bn/FusedBatchNormV3:0 -> (-1, 256, 28, 28)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_bn/FusedBatchNormV3:0 -> (-1, 256, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add:0 -> (-1, 256, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add:0 -> (-1, 256, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu:0 -> (-1, 256, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu:0 -> (-1, 256, 28, 28)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D_weights_fused_bn -> (64, 256, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D_bias_fused_bn -> (64)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 256, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 64, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_bn/FusedBatchNormV3:0 -> (-1, 64, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_bn/FusedBatchNormV3:0 -> (-1, 64, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu:0 -> (-1, 64, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu:0 -> (-1, 64, 28, 28)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_conv/Conv2D_weights_fused_bn -> (64, 64, 3, 3)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_conv/Conv2D_bias_fused_bn -> (64)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 64, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_bn/FusedBatchNormV3:0 -> (-1, 64, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_bn/FusedBatchNormV3:0 -> (-1, 64, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_relu/Relu:0 -> (-1, 64, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_relu/Relu:0 -> (-1, 64, 28, 28)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_conv/Conv2D_weights_fused_bn -> (256, 64, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_conv/Conv2D_bias_fused_bn -> (256)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 256, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_bn/FusedBatchNormV3:0 -> (-1, 256, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_add/add [Add]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu:0 -> (-1, 256, 28, 28)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_bn/FusedBatchNormV3:0 -> (-1, 256, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_add/add for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_add/add
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_add/add:0 -> (-1, 256, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_out/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_out/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_add/add:0 -> (-1, 256, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_out/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_out/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_out/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_out/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_out/Relu:0 -> (-1, 256, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_out/Relu:0 -> (-1, 256, 28, 28)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_conv/Conv2D_weights_fused_bn -> (64, 256, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_conv/Conv2D_bias_fused_bn -> (64)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 256, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 64, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_bn/FusedBatchNormV3:0 -> (-1, 64, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_bn/FusedBatchNormV3:0 -> (-1, 64, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_relu/Relu:0 -> (-1, 64, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_relu/Relu:0 -> (-1, 64, 28, 28)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_conv/Conv2D_weights_fused_bn -> (64, 64, 3, 3)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_conv/Conv2D_bias_fused_bn -> (64)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 64, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_bn/FusedBatchNormV3:0 -> (-1, 64, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_bn/FusedBatchNormV3:0 -> (-1, 64, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_relu/Relu:0 -> (-1, 64, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_relu/Relu:0 -> (-1, 64, 28, 28)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_conv/Conv2D_weights_fused_bn -> (256, 64, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_conv/Conv2D_bias_fused_bn -> (256)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 256, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_bn/FusedBatchNormV3:0 -> (-1, 256, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_add/add [Add]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_out/Relu:0 -> (-1, 256, 28, 28)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_bn/FusedBatchNormV3:0 -> (-1, 256, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_add/add for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_add/add
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_add/add:0 -> (-1, 256, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_out/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_out/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_add/add:0 -> (-1, 256, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_out/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_out/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_out/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_out/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_out/Relu:0 -> (-1, 256, 28, 28)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_out/Relu:0 -> (-1, 256, 28, 28)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D_weights_fused_bn -> (128, 256, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D_bias_fused_bn -> (128)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 256, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 128, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_bn/FusedBatchNormV3:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_bn/FusedBatchNormV3:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu:0 -> (-1, 128, 14, 14)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D_weights_fused_bn -> (128, 128, 3, 3)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D_bias_fused_bn -> (128)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 128, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_bn/FusedBatchNormV3:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_bn/FusedBatchNormV3:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu:0 -> (-1, 128, 14, 14)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D_weights_fused_bn -> (512, 128, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D_bias_fused_bn -> (512)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 512, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_bn/FusedBatchNormV3:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_out/Relu:0 -> (-1, 256, 28, 28)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D_weights_fused_bn -> (512, 256, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D_bias_fused_bn -> (512)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 256, 28, 28)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 512, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_bn/FusedBatchNormV3:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add [Add]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_bn/FusedBatchNormV3:0 -> (-1, 512, 14, 14)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_bn/FusedBatchNormV3:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu:0 -> (-1, 512, 14, 14)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D_weights_fused_bn -> (128, 512, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D_bias_fused_bn -> (128)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 512, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 128, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_bn/FusedBatchNormV3:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_bn/FusedBatchNormV3:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu:0 -> (-1, 128, 14, 14)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_conv/Conv2D_weights_fused_bn -> (128, 128, 3, 3)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_conv/Conv2D_bias_fused_bn -> (128)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 128, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_bn/FusedBatchNormV3:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_bn/FusedBatchNormV3:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_relu/Relu:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_relu/Relu:0 -> (-1, 128, 14, 14)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D_weights_fused_bn -> (512, 128, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D_bias_fused_bn -> (512)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 512, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_bn/FusedBatchNormV3:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add [Add]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu:0 -> (-1, 512, 14, 14)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_bn/FusedBatchNormV3:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu:0 -> (-1, 512, 14, 14)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_conv/Conv2D_weights_fused_bn -> (128, 512, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_conv/Conv2D_bias_fused_bn -> (128)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 512, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 128, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_bn/FusedBatchNormV3:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_bn/FusedBatchNormV3:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_relu/Relu:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_relu/Relu:0 -> (-1, 128, 14, 14)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_conv/Conv2D_weights_fused_bn -> (128, 128, 3, 3)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_conv/Conv2D_bias_fused_bn -> (128)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 128, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_bn/FusedBatchNormV3:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_bn/FusedBatchNormV3:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_relu/Relu:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_relu/Relu:0 -> (-1, 128, 14, 14)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_conv/Conv2D_weights_fused_bn -> (512, 128, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_conv/Conv2D_bias_fused_bn -> (512)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 512, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_bn/FusedBatchNormV3:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_add/add [Add]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu:0 -> (-1, 512, 14, 14)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_bn/FusedBatchNormV3:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_add/add for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_add/add
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_add/add:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_out/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_out/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_add/add:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_out/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_out/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_out/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_out/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_out/Relu:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_out/Relu:0 -> (-1, 512, 14, 14)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_conv/Conv2D_weights_fused_bn -> (128, 512, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_conv/Conv2D_bias_fused_bn -> (128)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 512, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 128, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_bn/FusedBatchNormV3:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_bn/FusedBatchNormV3:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_relu/Relu:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_relu/Relu:0 -> (-1, 128, 14, 14)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_conv/Conv2D_weights_fused_bn -> (128, 128, 3, 3)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_conv/Conv2D_bias_fused_bn -> (128)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 128, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_bn/FusedBatchNormV3:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_bn/FusedBatchNormV3:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_relu/Relu:0 -> (-1, 128, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_relu/Relu:0 -> (-1, 128, 14, 14)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_conv/Conv2D_weights_fused_bn -> (512, 128, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_conv/Conv2D_bias_fused_bn -> (512)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 512, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_bn/FusedBatchNormV3:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_add/add [Add]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_out/Relu:0 -> (-1, 512, 14, 14)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_bn/FusedBatchNormV3:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_add/add for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_add/add
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_add/add:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_out/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_out/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_add/add:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_out/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_out/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_out/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_out/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_out/Relu:0 -> (-1, 512, 14, 14)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_out/Relu:0 -> (-1, 512, 14, 14)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D_weights_fused_bn -> (256, 512, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D_bias_fused_bn -> (256)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 512, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu:0 -> (-1, 256, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D_bias_fused_bn -> (256)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu:0 -> (-1, 256, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D_weights_fused_bn -> (1024, 256, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D_bias_fused_bn -> (1024)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 1024, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_bn/FusedBatchNormV3:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_out/Relu:0 -> (-1, 512, 14, 14)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D_weights_fused_bn -> (1024, 512, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D_bias_fused_bn -> (1024)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 512, 14, 14)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 1024, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_bn/FusedBatchNormV3:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add [Add]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_bn/FusedBatchNormV3:0 -> (-1, 1024, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_bn/FusedBatchNormV3:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu:0 -> (-1, 1024, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D_weights_fused_bn -> (256, 1024, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D_bias_fused_bn -> (256)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 1024, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu:0 -> (-1, 256, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_conv/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_conv/Conv2D_bias_fused_bn -> (256)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_relu/Relu:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_relu/Relu:0 -> (-1, 256, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D_weights_fused_bn -> (1024, 256, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D_bias_fused_bn -> (1024)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 1024, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_bn/FusedBatchNormV3:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add [Add]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu:0 -> (-1, 1024, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_bn/FusedBatchNormV3:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu:0 -> (-1, 1024, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_conv/Conv2D_weights_fused_bn -> (256, 1024, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_conv/Conv2D_bias_fused_bn -> (256)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 1024, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_relu/Relu:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_relu/Relu:0 -> (-1, 256, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_conv/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_conv/Conv2D_bias_fused_bn -> (256)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_relu/Relu:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_3_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_relu/Relu:0 -> (-1, 256, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_3_conv/Conv2D_weights_fused_bn -> (1024, 256, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_3_conv/Conv2D_bias_fused_bn -> (1024)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_3_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 1024, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_3_bn/FusedBatchNormV3:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_add/add [Add]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu:0 -> (-1, 1024, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_3_bn/FusedBatchNormV3:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_add/add for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_add/add
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_add/add:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_out/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_out/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_add/add:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_out/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_out/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_out/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_out/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_out/Relu:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_out/Relu:0 -> (-1, 1024, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_conv/Conv2D_weights_fused_bn -> (256, 1024, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_conv/Conv2D_bias_fused_bn -> (256)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 1024, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_relu/Relu:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_relu/Relu:0 -> (-1, 256, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_conv/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_conv/Conv2D_bias_fused_bn -> (256)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_relu/Relu:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_3_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_relu/Relu:0 -> (-1, 256, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_3_conv/Conv2D_weights_fused_bn -> (1024, 256, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_3_conv/Conv2D_bias_fused_bn -> (1024)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_3_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 1024, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_3_bn/FusedBatchNormV3:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_add/add [Add]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_out/Relu:0 -> (-1, 1024, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_3_bn/FusedBatchNormV3:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_add/add for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_add/add
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_add/add:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_out/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_out/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_add/add:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_out/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_out/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_out/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_out/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_out/Relu:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_out/Relu:0 -> (-1, 1024, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_conv/Conv2D_weights_fused_bn -> (256, 1024, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_conv/Conv2D_bias_fused_bn -> (256)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 1024, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_relu/Relu:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_relu/Relu:0 -> (-1, 256, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_conv/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_conv/Conv2D_bias_fused_bn -> (256)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_relu/Relu:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_3_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_relu/Relu:0 -> (-1, 256, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_3_conv/Conv2D_weights_fused_bn -> (1024, 256, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_3_conv/Conv2D_bias_fused_bn -> (1024)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_3_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 1024, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_3_bn/FusedBatchNormV3:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_add/add [Add]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_out/Relu:0 -> (-1, 1024, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_3_bn/FusedBatchNormV3:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_add/add for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_add/add
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_add/add:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_out/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_out/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_add/add:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_out/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_out/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_out/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_out/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_out/Relu:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_out/Relu:0 -> (-1, 1024, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_conv/Conv2D_weights_fused_bn -> (256, 1024, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_conv/Conv2D_bias_fused_bn -> (256)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 1024, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_relu/Relu:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_relu/Relu:0 -> (-1, 256, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_conv/Conv2D_weights_fused_bn -> (256, 256, 3, 3)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_conv/Conv2D_bias_fused_bn -> (256)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_bn/FusedBatchNormV3:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_relu/Relu:0 -> (-1, 256, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_relu/Relu:0 -> (-1, 256, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D_weights_fused_bn -> (1024, 256, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D_bias_fused_bn -> (1024)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 256, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 1024, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_bn/FusedBatchNormV3:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add [Add]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_out/Relu:0 -> (-1, 1024, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_bn/FusedBatchNormV3:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu:0 -> (-1, 1024, 7, 7)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu:0 -> (-1, 1024, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D_weights_fused_bn -> (512, 1024, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D_bias_fused_bn -> (512)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 1024, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 512, 4, 4)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_bn/FusedBatchNormV3:0 -> (-1, 512, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_bn/FusedBatchNormV3:0 -> (-1, 512, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu:0 -> (-1, 512, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu:0 -> (-1, 512, 4, 4)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D_weights_fused_bn -> (512, 512, 3, 3)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D_bias_fused_bn -> (512)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 512, 4, 4)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 512, 4, 4)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_bn/FusedBatchNormV3:0 -> (-1, 512, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_bn/FusedBatchNormV3:0 -> (-1, 512, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu:0 -> (-1, 512, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu:0 -> (-1, 512, 4, 4)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D_weights_fused_bn -> (2048, 512, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D_bias_fused_bn -> (2048)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 512, 4, 4)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2048
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 2048, 4, 4)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_bn/FusedBatchNormV3:0 -> (-1, 2048, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu:0 -> (-1, 1024, 7, 7)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D_weights_fused_bn -> (2048, 1024, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D_bias_fused_bn -> (2048)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 1024, 7, 7)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2048
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 2048, 4, 4)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_bn/FusedBatchNormV3:0 -> (-1, 2048, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add [Add]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_bn/FusedBatchNormV3:0 -> (-1, 2048, 4, 4)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_bn/FusedBatchNormV3:0 -> (-1, 2048, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add:0 -> (-1, 2048, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add:0 -> (-1, 2048, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu:0 -> (-1, 2048, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu:0 -> (-1, 2048, 4, 4)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D_weights_fused_bn -> (512, 2048, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D_bias_fused_bn -> (512)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 2048, 4, 4)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 512, 4, 4)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_bn/FusedBatchNormV3:0 -> (-1, 512, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_bn/FusedBatchNormV3:0 -> (-1, 512, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu:0 -> (-1, 512, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu:0 -> (-1, 512, 4, 4)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_conv/Conv2D_weights_fused_bn -> (512, 512, 3, 3)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_conv/Conv2D_bias_fused_bn -> (512)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 512, 4, 4)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 512, 4, 4)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_bn/FusedBatchNormV3:0 -> (-1, 512, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_bn/FusedBatchNormV3:0 -> (-1, 512, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_relu/Relu:0 -> (-1, 512, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_relu/Relu:0 -> (-1, 512, 4, 4)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D_weights_fused_bn -> (2048, 512, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D_bias_fused_bn -> (2048)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 512, 4, 4)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2048
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 2048, 4, 4)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_bn/FusedBatchNormV3:0 -> (-1, 2048, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add [Add]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu:0 -> (-1, 2048, 4, 4)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_bn/FusedBatchNormV3:0 -> (-1, 2048, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add:0 -> (-1, 2048, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add:0 -> (-1, 2048, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu:0 -> (-1, 2048, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu:0 -> (-1, 2048, 4, 4)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_conv/Conv2D_weights_fused_bn -> (512, 2048, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_conv/Conv2D_bias_fused_bn -> (512)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 2048, 4, 4)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 512, 4, 4)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_bn/FusedBatchNormV3:0 -> (-1, 512, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_bn/FusedBatchNormV3:0 -> (-1, 512, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_relu/Relu:0 -> (-1, 512, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_relu/Relu:0 -> (-1, 512, 4, 4)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_conv/Conv2D_weights_fused_bn -> (512, 512, 3, 3)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_conv/Conv2D_bias_fused_bn -> (512)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 512, 4, 4)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 512, 4, 4)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_bn/FusedBatchNormV3:0 -> (-1, 512, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_relu/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_relu/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_bn/FusedBatchNormV3:0 -> (-1, 512, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_relu/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_relu/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_relu/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_relu/Relu:0 -> (-1, 512, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_3_conv/Conv2D [Conv]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_relu/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_3_conv/Conv2D_weights_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_3_conv/Conv2D_bias_fused_bn
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_3_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_relu/Relu:0 -> (-1, 512, 4, 4)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_3_conv/Conv2D_weights_fused_bn -> (2048, 512, 1, 1)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_3_conv/Conv2D_bias_fused_bn -> (2048)], 
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 512, 4, 4)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_3_conv/Conv2D for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_3_conv/Conv2D
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2048
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 2048, 4, 4)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_3_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_3_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_3_bn/FusedBatchNormV3:0 -> (-1, 2048, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_add/add [Add]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_3_bn/FusedBatchNormV3:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_add/add [Add] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu:0 -> (-1, 2048, 4, 4)], [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_3_bn/FusedBatchNormV3:0 -> (-1, 2048, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_add/add for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_add/add
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_add/add:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_add/add [Add] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_add/add:0 -> (-1, 2048, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_out/Relu [Relu]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_add/add:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_out/Relu [Relu] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_add/add:0 -> (-1, 2048, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_out/Relu for ONNX node: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_out/Relu
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_out/Relu:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_out/Relu [Relu] outputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_out/Relu:0 -> (-1, 2048, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean [GlobalAveragePool]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_out/Relu:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean [GlobalAveragePool] inputs: [StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_out/Relu:0 -> (-1, 2048, 4, 4)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean for ONNX node: StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean [GlobalAveragePool] outputs: [StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean:0 -> (-1, 2048, 1, 1)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean_Squeeze__613 [Squeeze]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean_Squeeze__613 [Squeeze] inputs: [StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean:0 -> (-1, 2048, 1, 1)], 
[06/29/2021-11:48:21] [06/29/2021-11:48:21] [V] [TRT] onnx2trt_utils.cpp:1663: Original shape: (_, 2048, 1, 1), squeezing to: (_, _)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean_Squeeze__613 for ONNX node: StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean_Squeeze__613
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean_Squeeze__613:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean_Squeeze__613:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean_Squeeze__613 [Squeeze] outputs: [StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean_Squeeze__613:0 -> (-1, -1)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/predictions/MatMul [MatMul]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean_Squeeze__613:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/predictions/MatMul/ReadVariableOp:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/predictions/MatMul [MatMul] inputs: [StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean_Squeeze__613:0 -> (-1, -1)], [StatefulPartitionedCall/ResNet50_my/predictions/MatMul/ReadVariableOp:0 -> (2048, 3)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: StatefulPartitionedCall/ResNet50_my/predictions/MatMul/ReadVariableOp:0 for ONNX initializer: StatefulPartitionedCall/ResNet50_my/predictions/MatMul/ReadVariableOp:0
[06/29/2021-11:48:21] [V] [TRT] builtin_op_importers.cpp:2121: GEMM: using FC layer instead of MM because all criteria were met.
[06/29/2021-11:48:21] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (_, _), unsqueezing to: (_, _, _, _)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/predictions/MatMul for ONNX node: StatefulPartitionedCall/ResNet50_my/predictions/MatMul
[06/29/2021-11:48:21] [V] [TRT] onnx2trt_utils.cpp:1663: Original shape: (_, 3, 1, 1), squeezing to: (_, _)
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/predictions/MatMul:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/predictions/MatMul:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/predictions/MatMul [MatMul] outputs: [StatefulPartitionedCall/ResNet50_my/predictions/MatMul:0 -> (-1, -1)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd [Add]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/predictions/MatMul:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd/ReadVariableOp:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd [Add] inputs: [StatefulPartitionedCall/ResNet50_my/predictions/MatMul:0 -> (-1, -1)], [StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd/ReadVariableOp:0 -> (3)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd/ReadVariableOp:0 for ONNX initializer: StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd/ReadVariableOp:0
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd for ONNX node: StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd [Add] outputs: [StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd:0 -> (-1, 3)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/ResNet50_my/predictions/Softmax [Softmax]
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd:0
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/ResNet50_my/predictions/Softmax [Softmax] inputs: [StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd:0 -> (-1, 3)], 
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:154: Registering layer: StatefulPartitionedCall/ResNet50_my/predictions/Softmax for ONNX node: StatefulPartitionedCall/ResNet50_my/predictions/Softmax
[06/29/2021-11:48:21] [V] [TRT] ImporterContext.hpp:120: Registering tensor: predictions_0 for ONNX tensor: predictions
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/ResNet50_my/predictions/Softmax [Softmax] outputs: [predictions -> (-1, -1)], 
[06/29/2021-11:48:21] [V] [TRT] ModelImporter.cpp:510: Marking predictions_0 as output: predictions
 ----- Parsing of ONNX model D:\TensorRT_forum\model.onnx is Done ---- 
[06/29/2021-11:48:21] [06/29/2021-11:48:21] [V] [TRT] Applying generic optimizations to the graph for inference.
[06/29/2021-11:48:21] [V] [TRT] Original: 132 layers
[06/29/2021-11:48:21] [V] [TRT] After dead-layer removal: 132 layers
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd/ReadVariableOp:0 with (Unnamed Layer* 139) [Shuffle]
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean_Squeeze__613 with (Unnamed Layer* 132) [Shuffle]
[06/29/2021-11:48:21] [V] [TRT] Removing StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean_Squeeze__613 + (Unnamed Layer* 132) [Shuffle]
[06/29/2021-11:48:21] [V] [TRT] Removing (Unnamed Layer* 146) [Shuffle]
[06/29/2021-11:48:21] [V] [TRT] Removing (Unnamed Layer* 148) [Shuffle]
[06/29/2021-11:48:21] [V] [TRT] After Myelin optimization: 127 layers
[06/29/2021-11:48:21] [V] [TRT] Convert layer type of StatefulPartitionedCall/ResNet50_my/predictions/MatMul from FULLY_CONNECTED to CONVOLUTION
[06/29/2021-11:48:21] [V] [TRT] Removing shuffle_before_StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean:0
[06/29/2021-11:48:21] [V] [TRT] After scale fusion: 127 layers
[06/29/2021-11:48:21] [V] [TRT] -----------SqueezePushDown kSQUEEZE_JOIN case: StatefulPartitionedCall/ResNet50_my/predictions/MatMul --> (Unnamed Layer* 137) [Shuffle] --> StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd/ReadVariableOp:0 + (Unnamed Layer* 139) [Shuffle] with unsqueeze_node_after_StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd/ReadVariableOp:0 + (Unnamed Layer* 139) [Shuffle]
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing Conv__435 with StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add with StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_add/add
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_add/add with StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_out/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_add/add
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_add/add with StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_out/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add with StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add with StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_add/add
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_add/add with StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_out/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_add/add
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_add/add with StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_out/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_3_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_add/add
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_add/add with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_out/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_3_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_add/add
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_add/add with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_out/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_3_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_add/add
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_add/add with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_out/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add with StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add with StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add with StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_relu/Relu
[06/29/2021-11:48:21] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_3_conv/Conv2D with StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_add/add
[06/29/2021-11:48:21] [V] [TRT] BinaryFusion: Fusing StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_add/add with StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_out/Relu
[06/29/2021-11:48:21] [V] [TRT] Swap the layer type of StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean from REDUCE to POOLING
[06/29/2021-11:48:21] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ResNet50_my/predictions/MatMul with StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd
[06/29/2021-11:48:21] [V] [TRT] After vertical fusions: 61 layers
[06/29/2021-11:48:21] [V] [TRT] After dupe layer removal: 60 layers
[06/29/2021-11:48:21] [V] [TRT] After final dead-layer removal: 60 layers
[06/29/2021-11:48:21] [V] [TRT] After tensor merging: 60 layers
[06/29/2021-11:48:21] [V] [TRT] After concat removal: 60 layers
[06/29/2021-11:48:21] [V] [TRT] Graph construction and optimization completed in 0.0093292 seconds.
[06/29/2021-11:48:22] [06/29/2021-11:48:22] [V] [TRT] Constructing optimization profile number 0 [1/1].
[06/29/2021-11:48:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:22] [V] [TRT] Tactic: 1002 time 0.005376
[06/29/2021-11:48:22] [V] [TRT] Tactic: 0 time 0.005704
[06/29/2021-11:48:22] [V] [TRT] Fastest Tactic: 1002 Time: 0.005376
[06/29/2021-11:48:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:22] [V] [TRT] Tactic: 1002 time 0.008196
[06/29/2021-11:48:22] [V] [TRT] Tactic: 0 time 0.00616
[06/29/2021-11:48:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00616
[06/29/2021-11:48:22] [V] [TRT] *************** Autotuning format combination: Float(1,3,336,37632) -> Float(1,112,12544,37632) ***************
[06/29/2021-11:48:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_conv/Conv2D__7 (Shuffle)
[06/29/2021-11:48:22] [V] [TRT] Tactic: 0 time 0.004608
[06/29/2021-11:48:22] [V] [TRT] Tactic: 1 time 0.00768
[06/29/2021-11:48:22] [V] [TRT] Fastest Tactic: 0 Time: 0.004608
[06/29/2021-11:48:22] [V] [TRT] *************** Autotuning format combination: Float(112,336,1,37632) -> Float(3,336,1,37632) ***************
[06/29/2021-11:48:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_conv/Conv2D__7 (Shuffle)
[06/29/2021-11:48:22] [V] [TRT] Tactic: 0 time 0.005888
[06/29/2021-11:48:22] [V] [TRT] Tactic: 1 time 0.005132
[06/29/2021-11:48:22] [V] [TRT] Fastest Tactic: 1 Time: 0.005132
[06/29/2021-11:48:22] [V] [TRT] *************** Autotuning format combination: Float(1,3,336:32,1344) -> Float(1,112,12544:32,12544) ***************
[06/29/2021-11:48:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_conv/Conv2D__7 (Shuffle)
[06/29/2021-11:48:22] [V] [TRT] Tactic: 0 time 0.023552
[06/29/2021-11:48:22] [V] [TRT] Tactic: 1 time 0.01332
[06/29/2021-11:48:22] [V] [TRT] Fastest Tactic: 1 Time: 0.01332
[06/29/2021-11:48:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:22] [V] [TRT] Tactic: 1002 time 0.00768
[06/29/2021-11:48:22] [V] [TRT] Tactic: 0 time 0.004456
[06/29/2021-11:48:22] [V] [TRT] Fastest Tactic: 0 Time: 0.004456
[06/29/2021-11:48:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:22] [V] [TRT] Tactic: 1002 time 0.007648
[06/29/2021-11:48:22] [V] [TRT] Tactic: 0 time 0.004548
[06/29/2021-11:48:22] [V] [TRT] Fastest Tactic: 0 Time: 0.004548
[06/29/2021-11:48:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:22] [V] [TRT] Tactic: 1002 time 0.007884
[06/29/2021-11:48:22] [V] [TRT] Tactic: 0 time 0.005164
[06/29/2021-11:48:22] [V] [TRT] Fastest Tactic: 0 Time: 0.005164
[06/29/2021-11:48:22] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:22] [V] [TRT] Tactic: 1002 time 0.009052
[06/29/2021-11:48:22] [V] [TRT] Tactic: 0 time 0.00464
[06/29/2021-11:48:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00464
[06/29/2021-11:48:22] [V] [TRT] *************** Autotuning format combination: Float(1,112,12544,37632) -> Float(1,56,3136,200704) ***************
[06/29/2021-11:48:22] [V] [TRT] Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:22] [V] [TRT] Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[06/29/2021-11:48:22] [V] [TRT] Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[06/29/2021-11:48:22] [V] [TRT] Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:22] [V] [TRT] Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:22] [V] [TRT] --------------- Timing Runner: Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:22] [V] [TRT] Tactic: 131071 time 0.020892
[06/29/2021-11:48:23] [V] [TRT] Tactic: 3276799 time 0.023972
[06/29/2021-11:48:23] [V] [TRT] Tactic: 8454143 time 0.022792
[06/29/2021-11:48:23] [V] [TRT] Fastest Tactic: 131071 Time: 0.020892
[06/29/2021-11:48:23] [V] [TRT] --------------- Timing Runner: Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (CaskConvolution)
[06/29/2021-11:48:23] [V] [TRT] Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:23] [V] [TRT] Tactic: 1825138533642645384 time 0.042544
[06/29/2021-11:48:23] [V] [TRT] Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[06/29/2021-11:48:23] [V] [TRT] Tactic: 2842488832350522458 time 0.040744
[06/29/2021-11:48:23] [V] [TRT] Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[06/29/2021-11:48:23] [V] [TRT] Tactic: 6448355332020552203 time 0.043056
[06/29/2021-11:48:23] [V] [TRT] Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:23] [V] [TRT] Tactic: -8060443123034038864 time 0.031488
[06/29/2021-11:48:23] [V] [TRT] Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:23] [V] [TRT] Tactic: -4420849921117327522 time 0.027932
[06/29/2021-11:48:23] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.027932
[06/29/2021-11:48:23] [V] [TRT] --------------- Timing Runner: Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (CudaConvolution)
[06/29/2021-11:48:23] [V] [TRT] Tactic: 0 time 53.4328
[06/29/2021-11:48:23] [V] [TRT] Tactic: 1 time 0.041216
[06/29/2021-11:48:23] [V] [TRT] Tactic: 2 time 0.05526
[06/29/2021-11:48:23] [V] [TRT] Tactic: 5 time 0.552192
[06/29/2021-11:48:23] [V] [TRT] Tactic: 56 time 0.03216
[06/29/2021-11:48:23] [V] [TRT] Tactic: 57 time 0.041472
[06/29/2021-11:48:23] [V] [TRT] Tactic: 58 time 0.054528
[06/29/2021-11:48:23] [V] [TRT] Tactic: 61 time 0.547984
[06/29/2021-11:48:23] [V] [TRT] Fastest Tactic: 56 Time: 0.03216
[06/29/2021-11:48:23] [V] [TRT] --------------- Timing Runner: Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:23] [V] [TRT] --------------- Timing Runner: Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (CublasConvolution)
[06/29/2021-11:48:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 131071
[06/29/2021-11:48:23] [V] [TRT] 
[06/29/2021-11:48:23] [V] [TRT] *************** Autotuning format combination: Float(3,336,1,37632) -> Float(64,3584,1,200704) ***************
[06/29/2021-11:48:23] [V] [TRT] Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:23] [V] [TRT] Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:23] [V] [TRT] --------------- Timing Runner: Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:23] [V] [TRT] --------------- Timing Runner: Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (CaskConvolution)
[06/29/2021-11:48:23] [V] [TRT] Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:23] [V] [TRT] Tactic: 861694390046228376 time 0.086784
[06/29/2021-11:48:23] [V] [TRT] Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:23] [V] [TRT] Tactic: -3853827649136781465 time 0.090512
[06/29/2021-11:48:23] [V] [TRT] Fastest Tactic: 861694390046228376 Time: 0.086784
[06/29/2021-11:48:23] [V] [TRT] --------------- Timing Runner: Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (CudaConvolution)
[06/29/2021-11:48:23] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:23] [V] [TRT] --------------- Timing Runner: Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:23] [V] [TRT] --------------- Timing Runner: Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (CublasConvolution)
[06/29/2021-11:48:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 861694390046228376
[06/29/2021-11:48:23] [V] [TRT] Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:23] [V] [TRT] 
[06/29/2021-11:48:23] [V] [TRT] Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:23] [V] [TRT] Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:23] [V] [TRT] Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:23] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:23] [V] [TRT] Tactic: 1002 time 0.01644
[06/29/2021-11:48:23] [V] [TRT] Tactic: 0 time 0.009084
[06/29/2021-11:48:23] [V] [TRT] Fastest Tactic: 0 Time: 0.009084
[06/29/2021-11:48:23] [V] [TRT] *************** Autotuning format combination: Float(1,56,3136,200704) -> Float(1,58,3364,215296) ***************
[06/29/2021-11:48:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pad/Pad (Padding)
[06/29/2021-11:48:23] [V] [TRT] Tactic: 0 is the only option, timing skipped
[06/29/2021-11:48:23] [V] [TRT] Fastest Tactic: 0 Time: 0
[06/29/2021-11:48:23] [V] [TRT] *************** Autotuning format combination: Float(1,58,3364,215296) -> Float(1,28,784,50176) ***************
[06/29/2021-11:48:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pool/MaxPool (Pooling)
[06/29/2021-11:48:23] [V] [TRT] Tactic: -1 time 0.006992
[06/29/2021-11:48:23] [V] [TRT] Fastest Tactic: -1 Time: 0.006992
[06/29/2021-11:48:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pool/MaxPool (TiledPooling)
[06/29/2021-11:48:23] [V] [TRT] Tactic: 257 time 0.006656
[06/29/2021-11:48:23] [V] [TRT] Tactic: 65793 time 0.006644
[06/29/2021-11:48:23] [V] [TRT] Tactic: 131329 time 0.008228
[06/29/2021-11:48:23] [V] [TRT] Tactic: 196865 time 0.011768
[06/29/2021-11:48:23] [V] [TRT] Tactic: 262401 time 0.01024
[06/29/2021-11:48:23] [V] [TRT] Tactic: 327937 time 0.008912
[06/29/2021-11:48:23] [V] [TRT] Tactic: 393473 time 0.007208
[06/29/2021-11:48:23] [V] [TRT] Tactic: 459009 time 0.005888
[06/29/2021-11:48:23] [V] [TRT] Tactic: 524545 time 0.006064
[06/29/2021-11:48:24] [V] [TRT] Tactic: 590081 time 0.006172
[06/29/2021-11:48:24] [V] [TRT] Tactic: 655617 time 0.008524
[06/29/2021-11:48:24] [V] [TRT] Tactic: 721153 time 0.008144
[06/29/2021-11:48:24] [V] [TRT] Tactic: 786689 time 0.007652
[06/29/2021-11:48:24] [V] [TRT] Tactic: 852225 time 0.006596
[06/29/2021-11:48:24] [V] [TRT] Tactic: 917761 time 0.005908
[06/29/2021-11:48:24] [V] [TRT] Tactic: 983297 time 0.005928
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1048833 time 0.006912
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1114369 time 0.00896
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1179905 time 0.007488
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1245441 time 0.007232
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1310977 time 0.0064
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1376513 time 0.005888
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1442049 time 0.005836
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1507585 time 0.005432
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1573121 time 0.007424
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1638657 time 0.006644
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1704193 time 0.00716
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1769729 time 0.005348
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1835265 time 0.005664
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1900801 time 0.005904
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1966337 time 0.005888
[06/29/2021-11:48:24] [V] [TRT] Tactic: 2031873 time 0.007184
[06/29/2021-11:48:24] [V] [TRT] Tactic: 2097409 time 0.006988
[06/29/2021-11:48:24] [V] [TRT] Tactic: 2162945 time 0.00662
[06/29/2021-11:48:24] [V] [TRT] Tactic: 2228481 time 0.005432
[06/29/2021-11:48:24] [V] [TRT] Tactic: 2294017 time 0.006024
[06/29/2021-11:48:24] [V] [TRT] Tactic: 2359553 time 0.006728
[06/29/2021-11:48:24] [V] [TRT] Tactic: 2425089 time 0.006144
[06/29/2021-11:48:24] [V] [TRT] Tactic: 2490625 time 0.006912
[06/29/2021-11:48:24] [V] [TRT] Tactic: 2556161 time 0.007304
[06/29/2021-11:48:24] [V] [TRT] Tactic: 2621697 time 0.007352
[06/29/2021-11:48:24] [V] [TRT] Tactic: 2687233 time 0.006392
[06/29/2021-11:48:24] [V] [TRT] Tactic: 6947073 time 0.005936
[06/29/2021-11:48:24] [V] [TRT] Fastest Tactic: 1769729 Time: 0.005348
[06/29/2021-11:48:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 1769729
[06/29/2021-11:48:24] [V] [TRT] 
[06/29/2021-11:48:24] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1002 time 0.005416
[06/29/2021-11:48:24] [V] [TRT] Tactic: 0 time 0.0053
[06/29/2021-11:48:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0053
[06/29/2021-11:48:24] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1002 time 0.006308
[06/29/2021-11:48:24] [V] [TRT] Tactic: 0 time 0.005184
[06/29/2021-11:48:24] [V] [TRT] Fastest Tactic: 0 Time: 0.005184
[06/29/2021-11:48:24] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1002 time 0.005376
[06/29/2021-11:48:24] [V] [TRT] Tactic: 0 time 0.005248
[06/29/2021-11:48:24] [V] [TRT] Fastest Tactic: 0 Time: 0.005248
[06/29/2021-11:48:24] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,50176) -> Float(1,28,784,50176) ***************
[06/29/2021-11:48:24] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:24] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:24] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:24] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:24] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:24] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:24] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:24] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:24] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:24] [V] [TRT] Tactic: 589823 time 0.027908
[06/29/2021-11:48:24] [V] [TRT] Tactic: 655359 time 0.019712
[06/29/2021-11:48:24] [V] [TRT] Tactic: 786431 time 0.012528
[06/29/2021-11:48:24] [V] [TRT] Tactic: 851967 time 0.012588
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1179647 time 0.010732
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1310719 time 0.01726
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1376255 time 0.021488
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1441791 time 0.010732
[06/29/2021-11:48:24] [V] [TRT] Tactic: 1507327 time 0.015
[06/29/2021-11:48:25] [V] [TRT] Tactic: 1638399 time 0.010096
[06/29/2021-11:48:25] [V] [TRT] Tactic: 1835007 time 0.013056
[06/29/2021-11:48:25] [V] [TRT] Tactic: 1900543 time 0.022788
[06/29/2021-11:48:25] [V] [TRT] Tactic: 2097151 time 0.009648
[06/29/2021-11:48:25] [V] [TRT] Tactic: 2162687 time 0.022232
[06/29/2021-11:48:25] [V] [TRT] Tactic: 2293759 time 0.020344
[06/29/2021-11:48:25] [V] [TRT] Tactic: 2359295 time 0.014692
[06/29/2021-11:48:25] [V] [TRT] Tactic: 2686975 time 0.021024
[06/29/2021-11:48:25] [V] [TRT] Tactic: 3080191 time 0.01342
[06/29/2021-11:48:25] [V] [TRT] Tactic: 3342335 time 0.014848
[06/29/2021-11:48:25] [V] [TRT] Tactic: 3407871 time 0.016176
[06/29/2021-11:48:25] [V] [TRT] Tactic: 3538943 time 0.011796
[06/29/2021-11:48:25] [V] [TRT] Tactic: 3670015 time 0.033784
[06/29/2021-11:48:25] [V] [TRT] Tactic: 3932159 time 0.017576
[06/29/2021-11:48:25] [V] [TRT] Tactic: 3997695 time 0.010496
[06/29/2021-11:48:25] [V] [TRT] Tactic: 4063231 time 0.011708
[06/29/2021-11:48:25] [V] [TRT] Tactic: 4194303 time 0.013312
[06/29/2021-11:48:25] [V] [TRT] Tactic: 4259839 time 0.009772
[06/29/2021-11:48:25] [V] [TRT] Tactic: 4325375 time 0.010556
[06/29/2021-11:48:25] [V] [TRT] Tactic: 4521983 time 0.020736
[06/29/2021-11:48:25] [V] [TRT] Tactic: 4587519 time 0.0102
[06/29/2021-11:48:25] [V] [TRT] Tactic: 4653055 time 0.01196
[06/29/2021-11:48:25] [V] [TRT] Tactic: 4915199 time 0.010172
[06/29/2021-11:48:25] [V] [TRT] Tactic: 4980735 time 0.013992
[06/29/2021-11:48:25] [V] [TRT] Tactic: 5177343 time 0.01038
[06/29/2021-11:48:25] [V] [TRT] Tactic: 5242879 time 0.014352
[06/29/2021-11:48:25] [V] [TRT] Tactic: 5373951 time 0.011504
[06/29/2021-11:48:25] [V] [TRT] Tactic: 5439487 time 0.013056
[06/29/2021-11:48:25] [V] [TRT] Tactic: 5570559 time 0.014352
[06/29/2021-11:48:25] [V] [TRT] Tactic: 5636095 time 0.011756
[06/29/2021-11:48:25] [V] [TRT] Tactic: 5701631 time 0.019476
[06/29/2021-11:48:25] [V] [TRT] Tactic: 5767167 time 0.016384
[06/29/2021-11:48:25] [V] [TRT] Tactic: 5832703 time 0.014144
[06/29/2021-11:48:25] [V] [TRT] Tactic: 5898239 time 0.010264
[06/29/2021-11:48:25] [V] [TRT] Tactic: 6029311 time 0.018444
[06/29/2021-11:48:25] [V] [TRT] Tactic: 6225919 time 0.013908
[06/29/2021-11:48:25] [V] [TRT] Tactic: 6291455 time 0.010488
[06/29/2021-11:48:25] [V] [TRT] Tactic: 6422527 time 0.01264
[06/29/2021-11:48:25] [V] [TRT] Tactic: 6750207 time 0.009944
[06/29/2021-11:48:25] [V] [TRT] Tactic: 6815743 time 0.014592
[06/29/2021-11:48:25] [V] [TRT] Tactic: 6946815 time 0.013168
[06/29/2021-11:48:25] [V] [TRT] Tactic: 7012351 time 0.01232
[06/29/2021-11:48:25] [V] [TRT] Tactic: 7077887 time 0.011496
[06/29/2021-11:48:25] [V] [TRT] Tactic: 7143423 time 0.014076
[06/29/2021-11:48:25] [V] [TRT] Tactic: 7208959 time 0.015032
[06/29/2021-11:48:25] [V] [TRT] Tactic: 7340031 time 0.01046
[06/29/2021-11:48:25] [V] [TRT] Tactic: 7405567 time 0.010876
[06/29/2021-11:48:26] [V] [TRT] Tactic: 7536639 time 0.017516
[06/29/2021-11:48:26] [V] [TRT] Tactic: 7602175 time 0.012492
[06/29/2021-11:48:26] [V] [TRT] Tactic: 7733247 time 0.010788
[06/29/2021-11:48:26] [V] [TRT] Tactic: 7798783 time 0.012476
[06/29/2021-11:48:26] [V] [TRT] Tactic: 8191999 time 0.011776
[06/29/2021-11:48:26] [V] [TRT] Tactic: 8257535 time 0.009984
[06/29/2021-11:48:26] [V] [TRT] Tactic: 8323071 time 0.012576
[06/29/2021-11:48:26] [V] [TRT] Tactic: 8650751 time 0.013072
[06/29/2021-11:48:26] [V] [TRT] Tactic: 8716287 time 0.014116
[06/29/2021-11:48:26] [V] [TRT] Tactic: 9109503 time 0.009712
[06/29/2021-11:48:26] [V] [TRT] Tactic: 9568255 time 0.010236
[06/29/2021-11:48:26] [V] [TRT] Tactic: 9895935 time 0.013056
[06/29/2021-11:48:26] [V] [TRT] Tactic: 10223615 time 0.021068
[06/29/2021-11:48:26] [V] [TRT] Tactic: 10354687 time 0.009844
[06/29/2021-11:48:26] [V] [TRT] Tactic: 10551295 time 0.014484
[06/29/2021-11:48:26] [V] [TRT] Tactic: 10747903 time 0.011988
[06/29/2021-11:48:26] [V] [TRT] Tactic: 10944511 time 0.013176
[06/29/2021-11:48:26] [V] [TRT] Fastest Tactic: 2097151 Time: 0.009648
[06/29/2021-11:48:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (CaskConvolution)
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: 1754569683116234317 time 0.023376
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: 1825138533642645384 time 0.023808
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: 2733356012094739613 time 0.026688
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: 3915320020053085238 time 0.023292
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: 6808617066150061604 time 0.01792
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: 9091006216302412844 time 0.026576
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: -8060443123034038864 time 0.019712
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: -4420849921117327522 time 0.01638
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: -3946921629105938337 time 0.020992
[06/29/2021-11:48:26] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.01638
[06/29/2021-11:48:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (CudaConvolution)
[06/29/2021-11:48:26] [V] [TRT] Tactic: 0 time 0.089864
[06/29/2021-11:48:26] [V] [TRT] Tactic: 1 time 0.02128
[06/29/2021-11:48:26] [V] [TRT] Tactic: 2 time 0.040712
[06/29/2021-11:48:26] [V] [TRT] Tactic: 4 skipped. Scratch requested: 36225024, available: 16777216
[06/29/2021-11:48:26] [V] [TRT] Tactic: 5 time 0.079616
[06/29/2021-11:48:26] [V] [TRT] Tactic: 56 time 0.017152
[06/29/2021-11:48:26] [V] [TRT] Tactic: 57 time 0.017684
[06/29/2021-11:48:26] [V] [TRT] Tactic: 58 time 0.04046
[06/29/2021-11:48:26] [V] [TRT] Tactic: 60 skipped. Scratch requested: 36225024, available: 16777216
[06/29/2021-11:48:26] [V] [TRT] Tactic: 61 time 0.042796
[06/29/2021-11:48:26] [I] [TRT] Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output.
[06/29/2021-11:48:26] [V] [TRT] Fastest Tactic: 56 Time: 0.017152
[06/29/2021-11:48:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (CublasConvolution)
[06/29/2021-11:48:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2097151
[06/29/2021-11:48:26] [V] [TRT] 
[06/29/2021-11:48:26] [V] [TRT] *************** Autotuning format combination: Float(64,1792,1,50176) -> Float(64,1792,1,50176) ***************
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (CaskConvolution)
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: 861694390046228376 time 0.022612
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: 5258189349241541167 time 0.015836
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: 5821621277990374316 time 0.021412
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: 5863767799113001648 time 0.012212
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: -9147980667639709536 time 0.022248
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: -8892196987859366827 time 0.022272
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: -8850904373104590857 time 0.016128
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: -8010679767156598961 time 0.021504
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: -7751035352149795660 time 0.021212
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: -5115676123557684531 time 0.02304
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: -493597327599791285 time 0.021248
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] Tactic: -423878181466897819 time 0.014364
[06/29/2021-11:48:26] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.012212
[06/29/2021-11:48:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (CudaConvolution)
[06/29/2021-11:48:26] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (CublasConvolution)
[06/29/2021-11:48:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] 
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:26] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,50176) -> Float(1,28,784,50176) ***************
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:26] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:26] [V] [TRT] Tactic: 524287 time 0.050604
[06/29/2021-11:48:26] [V] [TRT] Tactic: 720895 time 0.042588
[06/29/2021-11:48:26] [V] [TRT] Tactic: 983039 time 0.024396
[06/29/2021-11:48:27] [V] [TRT] Tactic: 1048575 time 0.036352
[06/29/2021-11:48:27] [V] [TRT] Tactic: 1703935 time 0.021408
[06/29/2021-11:48:27] [V] [TRT] Tactic: 1769471 time 0.025532
[06/29/2021-11:48:27] [V] [TRT] Tactic: 1966079 time 0.081484
[06/29/2021-11:48:27] [V] [TRT] Tactic: 2031615 time 0.069372
[06/29/2021-11:48:27] [V] [TRT] Tactic: 2228223 time 0.039064
[06/29/2021-11:48:27] [V] [TRT] Tactic: 2424831 time 0.020876
[06/29/2021-11:48:27] [V] [TRT] Tactic: 2621439 time 0.018456
[06/29/2021-11:48:27] [V] [TRT] Tactic: 2752511 time 0.047364
[06/29/2021-11:48:27] [V] [TRT] Tactic: 2818047 time 0.046336
[06/29/2021-11:48:27] [V] [TRT] Tactic: 2883583 time 0.094992
[06/29/2021-11:48:27] [V] [TRT] Tactic: 3014655 time 0.024568
[06/29/2021-11:48:27] [V] [TRT] Tactic: 3145727 time 0.03456
[06/29/2021-11:48:27] [V] [TRT] Tactic: 3473407 time 0.053
[06/29/2021-11:48:27] [V] [TRT] Tactic: 3604479 time 0.024576
[06/29/2021-11:48:27] [V] [TRT] Tactic: 3735551 time 0.038144
[06/29/2021-11:48:27] [V] [TRT] Tactic: 4390911 time 0.087096
[06/29/2021-11:48:27] [V] [TRT] Tactic: 5046271 time 0.03002
[06/29/2021-11:48:27] [V] [TRT] Tactic: 5963775 time 0.075048
[06/29/2021-11:48:27] [V] [TRT] Tactic: 6160383 time 0.044108
[06/29/2021-11:48:27] [V] [TRT] Tactic: 6488063 time 0.038372
[06/29/2021-11:48:27] [V] [TRT] Tactic: 6881279 time 0.063284
[06/29/2021-11:48:27] [V] [TRT] Tactic: 7274495 time 0.019456
[06/29/2021-11:48:27] [V] [TRT] Tactic: 7864319 time 0.02048
[06/29/2021-11:48:27] [V] [TRT] Tactic: 7995391 time 0.044288
[06/29/2021-11:48:27] [V] [TRT] Tactic: 8585215 time 0.058516
[06/29/2021-11:48:27] [V] [TRT] Tactic: 8847359 time 0.020804
[06/29/2021-11:48:27] [V] [TRT] Tactic: 8978431 time 0.075008
[06/29/2021-11:48:27] [V] [TRT] Tactic: 9043967 time 0.022644
[06/29/2021-11:48:27] [V] [TRT] Tactic: 9175039 time 0.025184
[06/29/2021-11:48:27] [V] [TRT] Tactic: 9502719 time 0.087052
[06/29/2021-11:48:27] [V] [TRT] Tactic: 9830399 time 0.040944
[06/29/2021-11:48:27] [V] [TRT] Tactic: 9961471 time 0.021652
[06/29/2021-11:48:27] [V] [TRT] Tactic: 10027007 time 0.032264
[06/29/2021-11:48:27] [V] [TRT] Tactic: 10092543 time 0.087676
[06/29/2021-11:48:27] [V] [TRT] Tactic: 10289151 time 0.081624
[06/29/2021-11:48:27] [V] [TRT] Tactic: 10485759 time 0.02048
[06/29/2021-11:48:27] [V] [TRT] Tactic: 10682367 time 0.019276
[06/29/2021-11:48:27] [V] [TRT] Tactic: 10813439 time 0.026536
[06/29/2021-11:48:27] [V] [TRT] Fastest Tactic: 2621439 Time: 0.018456
[06/29/2021-11:48:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (CaskConvolution)
[06/29/2021-11:48:27] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:27] [V] [TRT] Tactic: 1825138533642645384 time 0.124528
[06/29/2021-11:48:27] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[06/29/2021-11:48:27] [V] [TRT] Tactic: 2775507031594384867 time 0.022528
[06/29/2021-11:48:27] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[06/29/2021-11:48:27] [V] [TRT] Tactic: 2842488832350522458 time 0.083852
[06/29/2021-11:48:27] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:27] [V] [TRT] Tactic: 3915320020053085238 time 0.119852
[06/29/2021-11:48:27] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[06/29/2021-11:48:27] [V] [TRT] Tactic: 6448355332020552203 time 0.133244
[06/29/2021-11:48:27] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:27] [V] [TRT] Tactic: 6808617066150061604 time 0.074256
[06/29/2021-11:48:27] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:27] [V] [TRT] Tactic: -8060443123034038864 time 0.086224
[06/29/2021-11:48:27] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:27] [V] [TRT] Tactic: -4420849921117327522 time 0.075748
[06/29/2021-11:48:27] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:27] [V] [TRT] Tactic: -3946921629105938337 time 0.08832
[06/29/2021-11:48:27] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.022528
[06/29/2021-11:48:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (CudaConvolution)
[06/29/2021-11:48:28] [V] [TRT] Tactic: 0 time 0.044252
[06/29/2021-11:48:28] [V] [TRT] Tactic: 1 time 0.044208
[06/29/2021-11:48:28] [V] [TRT] Tactic: 2 time 0.083836
[06/29/2021-11:48:28] [V] [TRT] Tactic: 4 skipped. Scratch requested: 36356096, available: 16777216
[06/29/2021-11:48:28] [V] [TRT] Tactic: 5 skipped. Scratch requested: 18382848, available: 16777216
[06/29/2021-11:48:28] [V] [TRT] Tactic: 6 time 0.072948
[06/29/2021-11:48:28] [V] [TRT] Tactic: 56 time 0.044184
[06/29/2021-11:48:28] [V] [TRT] Tactic: 57 time 0.102656
[06/29/2021-11:48:28] [V] [TRT] Tactic: 58 time 0.084272
[06/29/2021-11:48:28] [V] [TRT] Tactic: 60 skipped. Scratch requested: 36356096, available: 16777216
[06/29/2021-11:48:28] [V] [TRT] Tactic: 61 skipped. Scratch requested: 18382848, available: 16777216
[06/29/2021-11:48:28] [V] [TRT] Tactic: 62 time 0.034044
[06/29/2021-11:48:28] [V] [TRT] Fastest Tactic: 62 Time: 0.034044
[06/29/2021-11:48:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:28] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (CublasConvolution)
[06/29/2021-11:48:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2621439
[06/29/2021-11:48:28] [V] [TRT] 
[06/29/2021-11:48:28] [V] [TRT] *************** Autotuning format combination: Float(64,1792,1,50176) -> Float(64,1792,1,50176) ***************
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:28] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (CaskConvolution)
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] Tactic: 861694390046228376 time 0.1216
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] Tactic: 1017870653102653567 time 0.123392
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] Tactic: 5258189349241541167 time 0.06712
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] Tactic: 5821621277990374316 time 0.119288
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] Tactic: 5863767799113001648 time 0.039912
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] Tactic: -9147980667639709536 time 0.134124
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] Tactic: -8850904373104590857 time 0.068836
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] Tactic: -7751035352149795660 time 0.119304
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] Tactic: -3853827649136781465 time 0.124836
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] Tactic: -3263369460438823196 time 0.0704
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] Tactic: -423878181466897819 time 0.040772
[06/29/2021-11:48:28] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.039912
[06/29/2021-11:48:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (CudaConvolution)
[06/29/2021-11:48:28] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:28] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (CublasConvolution)
[06/29/2021-11:48:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] 
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:28] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,50176) -> Float(1,28,784,200704) ***************
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:28] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (FusedConvActConvolution)
[06/29/2021-11:48:28] [V] [TRT] Tactic: 589823 time 0.035316
[06/29/2021-11:48:28] [V] [TRT] Tactic: 655359 time 0.032504
[06/29/2021-11:48:28] [V] [TRT] Tactic: 786431 time 0.02176
[06/29/2021-11:48:28] [V] [TRT] Tactic: 851967 time 0.023616
[06/29/2021-11:48:28] [V] [TRT] Tactic: 1179647 time 0.021476
[06/29/2021-11:48:28] [V] [TRT] Tactic: 1310719 time 0.025856
[06/29/2021-11:48:28] [V] [TRT] Tactic: 1376255 time 0.029744
[06/29/2021-11:48:28] [V] [TRT] Tactic: 1441791 time 0.022512
[06/29/2021-11:48:28] [V] [TRT] Tactic: 1507327 time 0.02432
[06/29/2021-11:48:28] [V] [TRT] Tactic: 1638399 time 0.021972
[06/29/2021-11:48:28] [V] [TRT] Tactic: 1835007 time 0.022272
[06/29/2021-11:48:28] [V] [TRT] Tactic: 1900543 time 0.03584
[06/29/2021-11:48:28] [V] [TRT] Tactic: 2097151 time 0.020992
[06/29/2021-11:48:28] [V] [TRT] Tactic: 2162687 time 0.029704
[06/29/2021-11:48:28] [V] [TRT] Tactic: 2293759 time 0.02928
[06/29/2021-11:48:28] [V] [TRT] Tactic: 2359295 time 0.023316
[06/29/2021-11:48:28] [V] [TRT] Tactic: 2686975 time 0.027868
[06/29/2021-11:48:28] [V] [TRT] Tactic: 3080191 time 0.021348
[06/29/2021-11:48:28] [V] [TRT] Tactic: 3342335 time 0.023808
[06/29/2021-11:48:28] [V] [TRT] Tactic: 3407871 time 0.024524
[06/29/2021-11:48:28] [V] [TRT] Tactic: 3538943 time 0.02306
[06/29/2021-11:48:28] [V] [TRT] Tactic: 3670015 time 0.04068
[06/29/2021-11:48:28] [V] [TRT] Tactic: 3932159 time 0.027608
[06/29/2021-11:48:28] [V] [TRT] Tactic: 3997695 time 0.021188
[06/29/2021-11:48:28] [V] [TRT] Tactic: 4063231 time 0.021744
[06/29/2021-11:48:28] [V] [TRT] Tactic: 4194303 time 0.02254
[06/29/2021-11:48:28] [V] [TRT] Tactic: 4259839 time 0.01948
[06/29/2021-11:48:28] [V] [TRT] Tactic: 4325375 time 0.020308
[06/29/2021-11:48:28] [V] [TRT] Tactic: 4521983 time 0.02712
[06/29/2021-11:48:29] [V] [TRT] Tactic: 4587519 time 0.021772
[06/29/2021-11:48:29] [V] [TRT] Tactic: 4653055 time 0.021992
[06/29/2021-11:48:29] [V] [TRT] Tactic: 4915199 time 0.020544
[06/29/2021-11:48:29] [V] [TRT] Tactic: 4980735 time 0.020544
[06/29/2021-11:48:29] [V] [TRT] Tactic: 5177343 time 0.021724
[06/29/2021-11:48:29] [V] [TRT] Tactic: 5242879 time 0.023808
[06/29/2021-11:48:29] [V] [TRT] Tactic: 5373951 time 0.022184
[06/29/2021-11:48:29] [V] [TRT] Tactic: 5439487 time 0.023228
[06/29/2021-11:48:29] [V] [TRT] Tactic: 5570559 time 0.022784
[06/29/2021-11:48:29] [V] [TRT] Tactic: 5636095 time 0.02172
[06/29/2021-11:48:29] [V] [TRT] Tactic: 5701631 time 0.027136
[06/29/2021-11:48:29] [V] [TRT] Tactic: 5767167 time 0.030796
[06/29/2021-11:48:29] [V] [TRT] Tactic: 5832703 time 0.022812
[06/29/2021-11:48:29] [V] [TRT] Tactic: 5898239 time 0.020156
[06/29/2021-11:48:29] [V] [TRT] Tactic: 6029311 time 0.026292
[06/29/2021-11:48:29] [V] [TRT] Tactic: 6225919 time 0.02122
[06/29/2021-11:48:29] [V] [TRT] Tactic: 6291455 time 0.021548
[06/29/2021-11:48:29] [V] [TRT] Tactic: 6422527 time 0.022272
[06/29/2021-11:48:29] [V] [TRT] Tactic: 6750207 time 0.020992
[06/29/2021-11:48:29] [V] [TRT] Tactic: 6815743 time 0.024576
[06/29/2021-11:48:29] [V] [TRT] Tactic: 6946815 time 0.023528
[06/29/2021-11:48:29] [V] [TRT] Tactic: 7012351 time 0.021248
[06/29/2021-11:48:29] [V] [TRT] Tactic: 7077887 time 0.02164
[06/29/2021-11:48:29] [V] [TRT] Tactic: 7143423 time 0.02768
[06/29/2021-11:48:29] [V] [TRT] Tactic: 7208959 time 0.02176
[06/29/2021-11:48:29] [V] [TRT] Tactic: 7340031 time 0.0205
[06/29/2021-11:48:29] [V] [TRT] Tactic: 7405567 time 0.02038
[06/29/2021-11:48:29] [V] [TRT] Tactic: 7536639 time 0.025856
[06/29/2021-11:48:29] [V] [TRT] Tactic: 7602175 time 0.022272
[06/29/2021-11:48:29] [V] [TRT] Tactic: 7733247 time 0.021248
[06/29/2021-11:48:29] [V] [TRT] Tactic: 7798783 time 0.02176
[06/29/2021-11:48:29] [V] [TRT] Tactic: 8191999 time 0.02466
[06/29/2021-11:48:29] [V] [TRT] Tactic: 8257535 time 0.02724
[06/29/2021-11:48:29] [V] [TRT] Tactic: 8323071 time 0.021916
[06/29/2021-11:48:29] [V] [TRT] Tactic: 8650751 time 0.021364
[06/29/2021-11:48:29] [V] [TRT] Tactic: 8716287 time 0.022488
[06/29/2021-11:48:29] [V] [TRT] Tactic: 9109503 time 0.020396
[06/29/2021-11:48:29] [V] [TRT] Tactic: 9568255 time 0.020912
[06/29/2021-11:48:29] [V] [TRT] Tactic: 9895935 time 0.022288
[06/29/2021-11:48:29] [V] [TRT] Tactic: 10223615 time 0.0279
[06/29/2021-11:48:29] [V] [TRT] Tactic: 10354687 time 0.019968
[06/29/2021-11:48:29] [V] [TRT] Tactic: 10551295 time 0.022968
[06/29/2021-11:48:29] [V] [TRT] Tactic: 10747903 time 0.020464
[06/29/2021-11:48:29] [V] [TRT] Tactic: 10944511 time 0.020664
[06/29/2021-11:48:29] [V] [TRT] Fastest Tactic: 4259839 Time: 0.01948
[06/29/2021-11:48:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (CaskConvolution)
[06/29/2021-11:48:29] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:29] [V] [TRT] Tactic: 1754569683116234317 time 0.025292
[06/29/2021-11:48:29] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:29] [V] [TRT] Tactic: 1825138533642645384 time 0.02402
[06/29/2021-11:48:29] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:29] [V] [TRT] Tactic: 2733356012094739613 time 0.019968
[06/29/2021-11:48:29] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:29] [V] [TRT] Tactic: 3915320020053085238 time 0.022624
[06/29/2021-11:48:29] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: 6808617066150061604 time 0.017148
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: 9091006216302412844 time 0.018372
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: -8060443123034038864 time 0.01934
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: -4420849921117327522 time 0.01664
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: -3946921629105938337 time 0.018256
[06/29/2021-11:48:30] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.01664
[06/29/2021-11:48:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (CudaConvolution)
[06/29/2021-11:48:30] [V] [TRT] Tactic: 0 time 0.019436
[06/29/2021-11:48:30] [V] [TRT] Tactic: 1 time 0.019256
[06/29/2021-11:48:30] [V] [TRT] Tactic: 2 time 0.044228
[06/29/2021-11:48:30] [V] [TRT] Tactic: 4 skipped. Scratch requested: 143228928, available: 16777216
[06/29/2021-11:48:30] [V] [TRT] Tactic: 5 time 0.048616
[06/29/2021-11:48:30] [V] [TRT] Tactic: 56 time 0.019968
[06/29/2021-11:48:30] [V] [TRT] Tactic: 57 time 0.019968
[06/29/2021-11:48:30] [V] [TRT] Tactic: 58 time 0.044288
[06/29/2021-11:48:30] [V] [TRT] Tactic: 60 skipped. Scratch requested: 143228928, available: 16777216
[06/29/2021-11:48:30] [V] [TRT] Tactic: 61 time 0.048428
[06/29/2021-11:48:30] [V] [TRT] Fastest Tactic: 1 Time: 0.019256
[06/29/2021-11:48:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[06/29/2021-11:48:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (CublasConvolution)
[06/29/2021-11:48:30] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4420849921117327522
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:30] [V] [TRT] 
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:30] [V] [TRT] *************** Autotuning format combination: Float(64,1792,1,50176) -> Float(256,7168,1,200704) ***************
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (FusedConvActConvolution)
[06/29/2021-11:48:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (CaskConvolution)
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: 861694390046228376 time 0.02278
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: 5258189349241541167 time 0.015104
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: 5821621277990374316 time 0.02168
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: 5863767799113001648 time 0.012872
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: -9147980667639709536 time 0.02944
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: -8892196987859366827 time 0.022524
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: -8850904373104590857 time 0.017668
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: -8010679767156598961 time 0.022784
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: -7751035352149795660 time 0.021696
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: -5115676123557684531 time 0.023776
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: -493597327599791285 time 0.021264
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: -423878181466897819 time 0.022276
[06/29/2021-11:48:30] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.012872
[06/29/2021-11:48:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (CudaConvolution)
[06/29/2021-11:48:30] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[06/29/2021-11:48:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (CublasConvolution)
[06/29/2021-11:48:30] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] 
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:30] [V] [TRT] Tactic: 1002 time 0.006784
[06/29/2021-11:48:30] [V] [TRT] Tactic: 0 time 0.009728
[06/29/2021-11:48:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.006784
[06/29/2021-11:48:30] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:30] [V] [TRT] Tactic: 1002 time 0.0067
[06/29/2021-11:48:30] [V] [TRT] Tactic: 0 time 0.009472
[06/29/2021-11:48:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.0067
[06/29/2021-11:48:30] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,50176), Float(1,28,784,200704) -> Float(1,28,784,200704) ***************
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (CaskConvolution)
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: 1754569683116234317 time 0.025856
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: 1825138533642645384 time 0.026252
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: 2733356012094739613 time 0.020728
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: 3915320020053085238 time 0.024032
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: 6808617066150061604 time 0.025036
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: 9091006216302412844 time 0.019204
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: -8060443123034038864 time 0.020788
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: -4420849921117327522 time 0.017152
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:30] [V] [TRT] Tactic: -3946921629105938337 time 0.019456
[06/29/2021-11:48:30] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.017152
[06/29/2021-11:48:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (CudaConvolution)
[06/29/2021-11:48:30] [V] [TRT] Tactic: 0 time 0.029012
[06/29/2021-11:48:30] [V] [TRT] Tactic: 1 time 0.02916
[06/29/2021-11:48:30] [V] [TRT] Tactic: 2 time 0.053968
[06/29/2021-11:48:30] [V] [TRT] Tactic: 4 skipped. Scratch requested: 143228928, available: 16777216
[06/29/2021-11:48:30] [V] [TRT] Tactic: 5 time 0.07296
[06/29/2021-11:48:30] [V] [TRT] Tactic: 56 time 0.037888
[06/29/2021-11:48:30] [V] [TRT] Tactic: 57 time 0.071196
[06/29/2021-11:48:30] [V] [TRT] Tactic: 58 time 0.054784
[06/29/2021-11:48:30] [V] [TRT] Tactic: 60 skipped. Scratch requested: 143228928, available: 16777216
[06/29/2021-11:48:30] [V] [TRT] Tactic: 61 time 0.061632
[06/29/2021-11:48:30] [V] [TRT] Fastest Tactic: 0 Time: 0.029012
[06/29/2021-11:48:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (CublasConvolution)
[06/29/2021-11:48:30] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4420849921117327522
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:30] [V] [TRT] 
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:30] [V] [TRT] *************** Autotuning format combination: Float(64,1792,1,50176), Float(256,7168,1,200704) -> Float(256,7168,1,200704) ***************
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (CaskConvolution)
[06/29/2021-11:48:30] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] Tactic: 861694390046228376 time 0.025316
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] Tactic: 5258189349241541167 time 0.016632
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] Tactic: 5821621277990374316 time 0.022828
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] Tactic: 5863767799113001648 time 0.014336
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] Tactic: -9147980667639709536 time 0.023808
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] Tactic: -8892196987859366827 time 0.023632
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] Tactic: -8850904373104590857 time 0.018336
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] Tactic: -8010679767156598961 time 0.020992
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] Tactic: -7751035352149795660 time 0.022552
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] Tactic: -5115676123557684531 time 0.024576
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] Tactic: -493597327599791285 time 0.017264
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] Tactic: -423878181466897819 time 0.063156
[06/29/2021-11:48:31] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.014336
[06/29/2021-11:48:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (CudaConvolution)
[06/29/2021-11:48:31] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (CublasConvolution)
[06/29/2021-11:48:31] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] 
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:31] [V] [TRT] Tactic: 1002 time 0.006848
[06/29/2021-11:48:31] [V] [TRT] Tactic: 0 time 0.00896
[06/29/2021-11:48:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.006848
[06/29/2021-11:48:31] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:31] [V] [TRT] Tactic: 1002 time 0.006656
[06/29/2021-11:48:31] [V] [TRT] Tactic: 0 time 0.010128
[06/29/2021-11:48:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.006656
[06/29/2021-11:48:31] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,50176) ***************
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:31] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:31] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:31] [V] [TRT] Tactic: 589823 time 0.08938
[06/29/2021-11:48:31] [V] [TRT] Tactic: 655359 time 0.05816
[06/29/2021-11:48:31] [V] [TRT] Tactic: 786431 time 0.02816
[06/29/2021-11:48:31] [V] [TRT] Tactic: 851967 time 0.024048
[06/29/2021-11:48:31] [V] [TRT] Tactic: 1179647 time 0.017732
[06/29/2021-11:48:31] [V] [TRT] Tactic: 1310719 time 0.046952
[06/29/2021-11:48:31] [V] [TRT] Tactic: 1376255 time 0.064252
[06/29/2021-11:48:31] [V] [TRT] Tactic: 1441791 time 0.018904
[06/29/2021-11:48:31] [V] [TRT] Tactic: 1507327 time 0.035584
[06/29/2021-11:48:31] [V] [TRT] Tactic: 1638399 time 0.01814
[06/29/2021-11:48:31] [V] [TRT] Tactic: 1835007 time 0.029608
[06/29/2021-11:48:31] [V] [TRT] Tactic: 1900543 time 0.064848
[06/29/2021-11:48:31] [V] [TRT] Tactic: 2097151 time 0.014884
[06/29/2021-11:48:31] [V] [TRT] Tactic: 2162687 time 0.066336
[06/29/2021-11:48:31] [V] [TRT] Tactic: 2293759 time 0.058364
[06/29/2021-11:48:31] [V] [TRT] Tactic: 2359295 time 0.037052
[06/29/2021-11:48:31] [V] [TRT] Tactic: 2686975 time 0.060844
[06/29/2021-11:48:31] [V] [TRT] Tactic: 3080191 time 0.031396
[06/29/2021-11:48:31] [V] [TRT] Tactic: 3342335 time 0.045492
[06/29/2021-11:48:31] [V] [TRT] Tactic: 3407871 time 0.033832
[06/29/2021-11:48:31] [V] [TRT] Tactic: 3538943 time 0.021712
[06/29/2021-11:48:31] [V] [TRT] Tactic: 3670015 time 0.110476
[06/29/2021-11:48:31] [V] [TRT] Tactic: 3932159 time 0.046848
[06/29/2021-11:48:31] [V] [TRT] Tactic: 3997695 time 0.018692
[06/29/2021-11:48:31] [V] [TRT] Tactic: 4063231 time 0.022856
[06/29/2021-11:48:31] [V] [TRT] Tactic: 4194303 time 0.025856
[06/29/2021-11:48:31] [V] [TRT] Tactic: 4259839 time 0.016252
[06/29/2021-11:48:31] [V] [TRT] Tactic: 4325375 time 0.019652
[06/29/2021-11:48:31] [V] [TRT] Tactic: 4521983 time 0.060416
[06/29/2021-11:48:31] [V] [TRT] Tactic: 4587519 time 0.019244
[06/29/2021-11:48:31] [V] [TRT] Tactic: 4653055 time 0.018632
[06/29/2021-11:48:31] [V] [TRT] Tactic: 4915199 time 0.017848
[06/29/2021-11:48:31] [V] [TRT] Tactic: 4980735 time 0.031488
[06/29/2021-11:48:32] [V] [TRT] Tactic: 5177343 time 0.017324
[06/29/2021-11:48:32] [V] [TRT] Tactic: 5242879 time 0.030976
[06/29/2021-11:48:32] [V] [TRT] Tactic: 5373951 time 0.01842
[06/29/2021-11:48:32] [V] [TRT] Tactic: 5439487 time 0.024372
[06/29/2021-11:48:32] [V] [TRT] Tactic: 5570559 time 0.03434
[06/29/2021-11:48:32] [V] [TRT] Tactic: 5636095 time 0.022016
[06/29/2021-11:48:32] [V] [TRT] Tactic: 5701631 time 0.056572
[06/29/2021-11:48:32] [V] [TRT] Tactic: 5767167 time 0.03796
[06/29/2021-11:48:32] [V] [TRT] Tactic: 5832703 time 0.033188
[06/29/2021-11:48:32] [V] [TRT] Tactic: 5898239 time 0.018968
[06/29/2021-11:48:32] [V] [TRT] Tactic: 6029311 time 0.053308
[06/29/2021-11:48:32] [V] [TRT] Tactic: 6225919 time 0.020176
[06/29/2021-11:48:32] [V] [TRT] Tactic: 6291455 time 0.017184
[06/29/2021-11:48:32] [V] [TRT] Tactic: 6422527 time 0.02908
[06/29/2021-11:48:32] [V] [TRT] Tactic: 6750207 time 0.017276
[06/29/2021-11:48:32] [V] [TRT] Tactic: 6815743 time 0.031452
[06/29/2021-11:48:32] [V] [TRT] Tactic: 6946815 time 0.02854
[06/29/2021-11:48:32] [V] [TRT] Tactic: 7012351 time 0.015616
[06/29/2021-11:48:32] [V] [TRT] Tactic: 7077887 time 0.021324
[06/29/2021-11:48:32] [V] [TRT] Tactic: 7143423 time 0.032
[06/29/2021-11:48:32] [V] [TRT] Tactic: 7208959 time 0.034032
[06/29/2021-11:48:32] [V] [TRT] Tactic: 7340031 time 0.018528
[06/29/2021-11:48:32] [V] [TRT] Tactic: 7405567 time 0.019024
[06/29/2021-11:48:32] [V] [TRT] Tactic: 7536639 time 0.046208
[06/29/2021-11:48:32] [V] [TRT] Tactic: 7602175 time 0.02562
[06/29/2021-11:48:32] [V] [TRT] Tactic: 7733247 time 0.021964
[06/29/2021-11:48:32] [V] [TRT] Tactic: 7798783 time 0.028416
[06/29/2021-11:48:32] [V] [TRT] Tactic: 8191999 time 0.02818
[06/29/2021-11:48:32] [V] [TRT] Tactic: 8257535 time 0.017664
[06/29/2021-11:48:32] [V] [TRT] Tactic: 8323071 time 0.022348
[06/29/2021-11:48:32] [V] [TRT] Tactic: 8650751 time 0.025856
[06/29/2021-11:48:32] [V] [TRT] Tactic: 8716287 time 0.022112
[06/29/2021-11:48:32] [V] [TRT] Tactic: 9109503 time 0.014748
[06/29/2021-11:48:32] [V] [TRT] Tactic: 9568255 time 0.017396
[06/29/2021-11:48:32] [V] [TRT] Tactic: 9895935 time 0.026576
[06/29/2021-11:48:32] [V] [TRT] Tactic: 10223615 time 0.060588
[06/29/2021-11:48:32] [V] [TRT] Tactic: 10354687 time 0.015872
[06/29/2021-11:48:32] [V] [TRT] Tactic: 10551295 time 0.03584
[06/29/2021-11:48:32] [V] [TRT] Tactic: 10747903 time 0.02176
[06/29/2021-11:48:32] [V] [TRT] Tactic: 10944511 time 0.030696
[06/29/2021-11:48:32] [V] [TRT] Fastest Tactic: 9109503 Time: 0.014748
[06/29/2021-11:48:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (CaskConvolution)
[06/29/2021-11:48:32] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:32] [V] [TRT] Tactic: 1754569683116234317 time 0.061944
[06/29/2021-11:48:32] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:32] [V] [TRT] Tactic: 1825138533642645384 time 0.060912
[06/29/2021-11:48:32] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:32] [V] [TRT] Tactic: 2733356012094739613 time 0.045384
[06/29/2021-11:48:32] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:32] [V] [TRT] Tactic: 3915320020053085238 time 0.058904
[06/29/2021-11:48:32] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:32] [V] [TRT] Tactic: 6808617066150061604 time 0.038408
[06/29/2021-11:48:32] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:32] [V] [TRT] Tactic: 9091006216302412844 time 0.038932
[06/29/2021-11:48:32] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:32] [V] [TRT] Tactic: -8060443123034038864 time 0.041344
[06/29/2021-11:48:32] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:32] [V] [TRT] Tactic: -4420849921117327522 time 0.037248
[06/29/2021-11:48:32] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: -3946921629105938337 time 0.045112
[06/29/2021-11:48:33] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.037248
[06/29/2021-11:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (CudaConvolution)
[06/29/2021-11:48:33] [V] [TRT] Tactic: 0 time 0.02688
[06/29/2021-11:48:33] [V] [TRT] Tactic: 1 time 0.02562
[06/29/2021-11:48:33] [V] [TRT] Tactic: 2 time 0.124616
[06/29/2021-11:48:33] [V] [TRT] Tactic: 4 skipped. Scratch requested: 144900096, available: 16777216
[06/29/2021-11:48:33] [V] [TRT] Tactic: 5 time 0.057668
[06/29/2021-11:48:33] [V] [TRT] Tactic: 56 time 0.041188
[06/29/2021-11:48:33] [V] [TRT] Tactic: 57 time 0.068416
[06/29/2021-11:48:33] [V] [TRT] Tactic: 58 time 0.124524
[06/29/2021-11:48:33] [V] [TRT] Tactic: 60 skipped. Scratch requested: 144900096, available: 16777216
[06/29/2021-11:48:33] [V] [TRT] Tactic: 61 time 0.057104
[06/29/2021-11:48:33] [V] [TRT] Fastest Tactic: 1 Time: 0.02562
[06/29/2021-11:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (CublasConvolution)
[06/29/2021-11:48:33] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 9109503
[06/29/2021-11:48:33] [V] [TRT] 
[06/29/2021-11:48:33] [V] [TRT] *************** Autotuning format combination: Float(256,7168,1,200704) -> Float(64,1792,1,50176) ***************
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (CaskConvolution)
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: 861694390046228376 time 0.060024
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: 5258189349241541167 time 0.035076
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: 5821621277990374316 time 0.064768
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: 5863767799113001648 time 0.022428
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: -9147980667639709536 time 0.087292
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: -8892196987859366827 time 0.05976
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: -8850904373104590857 time 0.057588
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: -8010679767156598961 time 0.088624
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: -7751035352149795660 time 0.05792
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: -5115676123557684531 time 0.059468
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: -493597327599791285 time 0.03456
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: -423878181466897819 time 0.023552
[06/29/2021-11:48:33] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.022428
[06/29/2021-11:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (CudaConvolution)
[06/29/2021-11:48:33] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (CublasConvolution)
[06/29/2021-11:48:33] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] 
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,50176) -> Float(1,28,784,50176) ***************
[06/29/2021-11:48:33] [V] [TRT] *************** Autotuning format combination: Float(64,1792,1,50176) -> Float(64,1792,1,50176) ***************
[06/29/2021-11:48:33] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,50176), Float(1,28,784,200704) -> Float(1,28,784,200704) ***************
[06/29/2021-11:48:33] [V] [TRT] *************** Autotuning format combination: Float(64,1792,1,50176), Float(256,7168,1,200704) -> Float(256,7168,1,200704) ***************
[06/29/2021-11:48:33] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,28,784,50176) ***************
[06/29/2021-11:48:33] [V] [TRT] *************** Autotuning format combination: Float(256,7168,1,200704) -> Float(64,1792,1,50176) ***************
[06/29/2021-11:48:33] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,50176) -> Float(1,28,784,50176) ***************
[06/29/2021-11:48:33] [V] [TRT] *************** Autotuning format combination: Float(64,1792,1,50176) -> Float(64,1792,1,50176) ***************
[06/29/2021-11:48:33] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,50176), Float(1,28,784,200704) -> Float(1,28,784,200704) ***************
[06/29/2021-11:48:33] [V] [TRT] *************** Autotuning format combination: Float(64,1792,1,50176), Float(256,7168,1,200704) -> Float(256,7168,1,200704) ***************
[06/29/2021-11:48:33] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,200704) -> Float(1,14,196,25088) ***************
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (CaskConvolution)
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: 1754569683116234317 time 0.062144
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: 1825138533642645384 time 0.061856
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: 2733356012094739613 time 0.047568
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: 3915320020053085238 time 0.059496
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: 6808617066150061604 time 0.038308
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: 9091006216302412844 time 0.038192
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: -8060443123034038864 time 0.041988
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: -4420849921117327522 time 0.038736
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: -3946921629105938337 time 0.046592
[06/29/2021-11:48:33] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.038192
[06/29/2021-11:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (CudaConvolution)
[06/29/2021-11:48:33] [V] [TRT] Tactic: 0 time 0.026456
[06/29/2021-11:48:33] [V] [TRT] Tactic: 1 time 0.103608
[06/29/2021-11:48:33] [V] [TRT] Tactic: 2 time 0.137004
[06/29/2021-11:48:33] [V] [TRT] Tactic: 56 time 0.026568
[06/29/2021-11:48:33] [V] [TRT] Tactic: 57 time 0.049472
[06/29/2021-11:48:33] [V] [TRT] Tactic: 58 time 0.1364
[06/29/2021-11:48:33] [V] [TRT] Fastest Tactic: 0 Time: 0.026456
[06/29/2021-11:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (CublasConvolution)
[06/29/2021-11:48:33] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0
[06/29/2021-11:48:33] [V] [TRT] 
[06/29/2021-11:48:33] [V] [TRT] *************** Autotuning format combination: Float(256,7168,1,200704) -> Float(128,1792,1,25088) ***************
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (CaskConvolution)
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: 861694390046228376 time 0.060124
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: 5258189349241541167 time 0.03412
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: 5821621277990374316 time 0.058112
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: 5863767799113001648 time 0.022204
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: -9147980667639709536 time 0.059412
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: -8892196987859366827 time 0.05982
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: -8850904373104590857 time 0.03538
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: -8010679767156598961 time 0.024144
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: -7751035352149795660 time 0.057692
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: -5115676123557684531 time 0.05942
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: -493597327599791285 time 0.034116
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] Tactic: -423878181466897819 time 0.024064
[06/29/2021-11:48:33] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.022204
[06/29/2021-11:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (CudaConvolution)
[06/29/2021-11:48:33] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (CublasConvolution)
[06/29/2021-11:48:33] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] 
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:33] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:33] [V] [TRT] Tactic: 1002 time 0.005632
[06/29/2021-11:48:33] [V] [TRT] Tactic: 0 time 0.004864
[06/29/2021-11:48:33] [V] [TRT] Fastest Tactic: 0 Time: 0.004864
[06/29/2021-11:48:33] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:33] [V] [TRT] Tactic: 1002 time 0.005372
[06/29/2021-11:48:34] [V] [TRT] Tactic: 0 time 0.004844
[06/29/2021-11:48:34] [V] [TRT] Fastest Tactic: 0 Time: 0.004844
[06/29/2021-11:48:34] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,25088) -> Float(1,14,196,25088) ***************
[06/29/2021-11:48:34] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:34] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[06/29/2021-11:48:34] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[06/29/2021-11:48:34] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:34] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[06/29/2021-11:48:34] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:34] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:34] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:34] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:34] [V] [TRT] Tactic: 524287 time 0.093184
[06/29/2021-11:48:34] [V] [TRT] Tactic: 720895 time 0.077348
[06/29/2021-11:48:34] [V] [TRT] Tactic: 983039 time 0.0406
[06/29/2021-11:48:34] [V] [TRT] Tactic: 1048575 time 0.06124
[06/29/2021-11:48:34] [V] [TRT] Tactic: 1703935 time 0.033536
[06/29/2021-11:48:34] [V] [TRT] Tactic: 1769471 time 0.040704
[06/29/2021-11:48:34] [V] [TRT] Tactic: 1966079 time 0.154576
[06/29/2021-11:48:34] [V] [TRT] Tactic: 2031615 time 0.129024
[06/29/2021-11:48:34] [V] [TRT] Tactic: 2228223 time 0.067548
[06/29/2021-11:48:34] [V] [TRT] Tactic: 2424831 time 0.030052
[06/29/2021-11:48:34] [V] [TRT] Tactic: 2621439 time 0.02744
[06/29/2021-11:48:34] [V] [TRT] Tactic: 2752511 time 0.08624
[06/29/2021-11:48:34] [V] [TRT] Tactic: 2818047 time 0.086088
[06/29/2021-11:48:34] [V] [TRT] Tactic: 2883583 time 0.182804
[06/29/2021-11:48:34] [V] [TRT] Tactic: 3014655 time 0.040964
[06/29/2021-11:48:34] [V] [TRT] Tactic: 3145727 time 0.04736
[06/29/2021-11:48:34] [V] [TRT] Tactic: 3473407 time 0.09552
[06/29/2021-11:48:34] [V] [TRT] Tactic: 3604479 time 0.04088
[06/29/2021-11:48:34] [V] [TRT] Tactic: 3735551 time 0.067416
[06/29/2021-11:48:34] [V] [TRT] Tactic: 4390911 time 0.165088
[06/29/2021-11:48:34] [V] [TRT] Tactic: 5046271 time 0.050916
[06/29/2021-11:48:34] [V] [TRT] Tactic: 5963775 time 0.140892
[06/29/2021-11:48:34] [V] [TRT] Tactic: 6160383 time 0.080376
[06/29/2021-11:48:34] [V] [TRT] Tactic: 6488063 time 0.069412
[06/29/2021-11:48:34] [V] [TRT] Tactic: 6881279 time 0.114944
[06/29/2021-11:48:34] [V] [TRT] Tactic: 7274495 time 0.027904
[06/29/2021-11:48:34] [V] [TRT] Tactic: 7864319 time 0.029296
[06/29/2021-11:48:34] [V] [TRT] Tactic: 7995391 time 0.0804
[06/29/2021-11:48:34] [V] [TRT] Tactic: 8585215 time 0.10752
[06/29/2021-11:48:34] [V] [TRT] Tactic: 8847359 time 0.033064
[06/29/2021-11:48:34] [V] [TRT] Tactic: 8978431 time 0.139604
[06/29/2021-11:48:34] [V] [TRT] Tactic: 9043967 time 0.037612
[06/29/2021-11:48:34] [V] [TRT] Tactic: 9175039 time 0.04096
[06/29/2021-11:48:34] [V] [TRT] Tactic: 9502719 time 0.1648
[06/29/2021-11:48:34] [V] [TRT] Tactic: 9830399 time 0.074248
[06/29/2021-11:48:34] [V] [TRT] Tactic: 9961471 time 0.033944
[06/29/2021-11:48:34] [V] [TRT] Tactic: 10027007 time 0.055052
[06/29/2021-11:48:34] [V] [TRT] Tactic: 10092543 time 0.165516
[06/29/2021-11:48:34] [V] [TRT] Tactic: 10289151 time 0.153676
[06/29/2021-11:48:34] [V] [TRT] Tactic: 10485759 time 0.030688
[06/29/2021-11:48:34] [V] [TRT] Tactic: 10682367 time 0.02742
[06/29/2021-11:48:34] [V] [TRT] Tactic: 10813439 time 0.045264
[06/29/2021-11:48:34] [V] [TRT] Fastest Tactic: 10682367 Time: 0.02742
[06/29/2021-11:48:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (CaskConvolution)
[06/29/2021-11:48:34] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:34] [V] [TRT] Tactic: 1825138533642645384 time 0.237324
[06/29/2021-11:48:34] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[06/29/2021-11:48:34] [V] [TRT] Tactic: 2775507031594384867 time 0.038184
[06/29/2021-11:48:34] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[06/29/2021-11:48:34] [V] [TRT] Tactic: 2842488832350522458 time 0.183132
[06/29/2021-11:48:34] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:34] [V] [TRT] Tactic: 3915320020053085238 time 0.227836
[06/29/2021-11:48:34] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[06/29/2021-11:48:34] [V] [TRT] Tactic: 6448355332020552203 time 0.240084
[06/29/2021-11:48:34] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:34] [V] [TRT] Tactic: 6808617066150061604 time 0.137664
[06/29/2021-11:48:34] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:34] [V] [TRT] Tactic: -8060443123034038864 time 0.163552
[06/29/2021-11:48:34] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:34] [V] [TRT] Tactic: -4420849921117327522 time 0.146176
[06/29/2021-11:48:34] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:34] [V] [TRT] Tactic: -3946921629105938337 time 0.167232
[06/29/2021-11:48:34] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.038184
[06/29/2021-11:48:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (CudaConvolution)
[06/29/2021-11:48:34] [V] [TRT] Tactic: 0 time 0.074636
[06/29/2021-11:48:34] [V] [TRT] Tactic: 1 time 0.227216
[06/29/2021-11:48:34] [V] [TRT] Tactic: 2 time 0.101844
[06/29/2021-11:48:34] [V] [TRT] Tactic: 4 skipped. Scratch requested: 38633472, available: 16777216
[06/29/2021-11:48:34] [V] [TRT] Tactic: 5 skipped. Scratch requested: 72417280, available: 16777216
[06/29/2021-11:48:34] [V] [TRT] Tactic: 6 time 0.089124
[06/29/2021-11:48:34] [V] [TRT] Tactic: 56 time 0.074496
[06/29/2021-11:48:34] [V] [TRT] Tactic: 57 time 0.227076
[06/29/2021-11:48:34] [V] [TRT] Tactic: 58 time 0.100864
[06/29/2021-11:48:34] [V] [TRT] Tactic: 60 skipped. Scratch requested: 38633472, available: 16777216
[06/29/2021-11:48:34] [V] [TRT] Tactic: 61 skipped. Scratch requested: 72417280, available: 16777216
[06/29/2021-11:48:35] [V] [TRT] Tactic: 62 time 0.049912
[06/29/2021-11:48:35] [V] [TRT] Fastest Tactic: 62 Time: 0.049912
[06/29/2021-11:48:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (CublasConvolution)
[06/29/2021-11:48:35] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10682367
[06/29/2021-11:48:35] [V] [TRT] 
[06/29/2021-11:48:35] [V] [TRT] *************** Autotuning format combination: Float(128,1792,1,25088) -> Float(128,1792,1,25088) ***************
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:35] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (CaskConvolution)
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] Tactic: 861694390046228376 time 0.232568
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] Tactic: 1017870653102653567 time 0.234236
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] Tactic: 5258189349241541167 time 0.123532
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] Tactic: 5821621277990374316 time 0.227816
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] Tactic: 5863767799113001648 time 0.069748
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] Tactic: -9147980667639709536 time 0.230776
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] Tactic: -8850904373104590857 time 0.126208
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] Tactic: -7751035352149795660 time 0.228236
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] Tactic: -3853827649136781465 time 0.236172
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] Tactic: -3263369460438823196 time 0.127444
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] Tactic: -423878181466897819 time 0.070912
[06/29/2021-11:48:35] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.069748
[06/29/2021-11:48:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (CudaConvolution)
[06/29/2021-11:48:35] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (CublasConvolution)
[06/29/2021-11:48:35] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] 
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:35] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,25088) -> Float(1,14,196,100352) ***************
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:35] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (FusedConvActConvolution)
[06/29/2021-11:48:35] [V] [TRT] Tactic: 589823 time 0.050944
[06/29/2021-11:48:35] [V] [TRT] Tactic: 655359 time 0.037336
[06/29/2021-11:48:35] [V] [TRT] Tactic: 786431 time 0.021216
[06/29/2021-11:48:35] [V] [TRT] Tactic: 851967 time 0.019044
[06/29/2021-11:48:35] [V] [TRT] Tactic: 1179647 time 0.016384
[06/29/2021-11:48:35] [V] [TRT] Tactic: 1310719 time 0.029708
[06/29/2021-11:48:35] [V] [TRT] Tactic: 1376255 time 0.038728
[06/29/2021-11:48:35] [V] [TRT] Tactic: 1441791 time 0.019948
[06/29/2021-11:48:35] [V] [TRT] Tactic: 1507327 time 0.025896
[06/29/2021-11:48:35] [V] [TRT] Tactic: 1638399 time 0.021772
[06/29/2021-11:48:35] [V] [TRT] Tactic: 1835007 time 0.022324
[06/29/2021-11:48:35] [V] [TRT] Tactic: 1900543 time 0.0427
[06/29/2021-11:48:35] [V] [TRT] Tactic: 2097151 time 0.01666
[06/29/2021-11:48:35] [V] [TRT] Tactic: 2162687 time 0.038872
[06/29/2021-11:48:35] [V] [TRT] Tactic: 2293759 time 0.035584
[06/29/2021-11:48:35] [V] [TRT] Tactic: 2359295 time 0.025708
[06/29/2021-11:48:35] [V] [TRT] Tactic: 2686975 time 0.03584
[06/29/2021-11:48:35] [V] [TRT] Tactic: 3080191 time 0.023552
[06/29/2021-11:48:35] [V] [TRT] Tactic: 3342335 time 0.024576
[06/29/2021-11:48:35] [V] [TRT] Tactic: 3407871 time 0.02326
[06/29/2021-11:48:35] [V] [TRT] Tactic: 3538943 time 0.017152
[06/29/2021-11:48:35] [V] [TRT] Tactic: 3670015 time 0.060672
[06/29/2021-11:48:35] [V] [TRT] Tactic: 3932159 time 0.029772
[06/29/2021-11:48:35] [V] [TRT] Tactic: 3997695 time 0.018176
[06/29/2021-11:48:35] [V] [TRT] Tactic: 4063231 time 0.02032
[06/29/2021-11:48:35] [V] [TRT] Tactic: 4194303 time 0.021
[06/29/2021-11:48:35] [V] [TRT] Tactic: 4259839 time 0.017404
[06/29/2021-11:48:35] [V] [TRT] Tactic: 4325375 time 0.019712
[06/29/2021-11:48:35] [V] [TRT] Tactic: 4521983 time 0.036616
[06/29/2021-11:48:35] [V] [TRT] Tactic: 4587519 time 0.018732
[06/29/2021-11:48:35] [V] [TRT] Tactic: 4653055 time 0.019456
[06/29/2021-11:48:35] [V] [TRT] Tactic: 4915199 time 0.0168
[06/29/2021-11:48:35] [V] [TRT] Tactic: 4980735 time 0.02304
[06/29/2021-11:48:35] [V] [TRT] Tactic: 5177343 time 0.017632
[06/29/2021-11:48:35] [V] [TRT] Tactic: 5242879 time 0.022204
[06/29/2021-11:48:35] [V] [TRT] Tactic: 5373951 time 0.017948
[06/29/2021-11:48:35] [V] [TRT] Tactic: 5439487 time 0.022016
[06/29/2021-11:48:35] [V] [TRT] Tactic: 5570559 time 0.023552
[06/29/2021-11:48:35] [V] [TRT] Tactic: 5636095 time 0.019892
[06/29/2021-11:48:35] [V] [TRT] Tactic: 5701631 time 0.03506
[06/29/2021-11:48:35] [V] [TRT] Tactic: 5767167 time 0.024832
[06/29/2021-11:48:35] [V] [TRT] Tactic: 5832703 time 0.024036
[06/29/2021-11:48:35] [V] [TRT] Tactic: 5898239 time 0.016448
[06/29/2021-11:48:35] [V] [TRT] Tactic: 6029311 time 0.033128
[06/29/2021-11:48:35] [V] [TRT] Tactic: 6225919 time 0.017664
[06/29/2021-11:48:35] [V] [TRT] Tactic: 6291455 time 0.016408
[06/29/2021-11:48:35] [V] [TRT] Tactic: 6422527 time 0.02176
[06/29/2021-11:48:36] [V] [TRT] Tactic: 6750207 time 0.019288
[06/29/2021-11:48:36] [V] [TRT] Tactic: 6815743 time 0.022528
[06/29/2021-11:48:36] [V] [TRT] Tactic: 6946815 time 0.021908
[06/29/2021-11:48:36] [V] [TRT] Tactic: 7012351 time 0.0168
[06/29/2021-11:48:36] [V] [TRT] Tactic: 7077887 time 0.017532
[06/29/2021-11:48:36] [V] [TRT] Tactic: 7143423 time 0.024564
[06/29/2021-11:48:36] [V] [TRT] Tactic: 7208959 time 0.023448
[06/29/2021-11:48:36] [V] [TRT] Tactic: 7340031 time 0.016564
[06/29/2021-11:48:36] [V] [TRT] Tactic: 7405567 time 0.017408
[06/29/2021-11:48:36] [V] [TRT] Tactic: 7536639 time 0.02944
[06/29/2021-11:48:36] [V] [TRT] Tactic: 7602175 time 0.027888
[06/29/2021-11:48:36] [V] [TRT] Tactic: 7733247 time 0.018176
[06/29/2021-11:48:36] [V] [TRT] Tactic: 7798783 time 0.020996
[06/29/2021-11:48:36] [V] [TRT] Tactic: 8191999 time 0.02162
[06/29/2021-11:48:36] [V] [TRT] Tactic: 8257535 time 0.018184
[06/29/2021-11:48:36] [V] [TRT] Tactic: 8323071 time 0.020736
[06/29/2021-11:48:36] [V] [TRT] Tactic: 8650751 time 0.021476
[06/29/2021-11:48:36] [V] [TRT] Tactic: 8716287 time 0.018968
[06/29/2021-11:48:36] [V] [TRT] Tactic: 9109503 time 0.017152
[06/29/2021-11:48:36] [V] [TRT] Tactic: 9568255 time 0.01682
[06/29/2021-11:48:36] [V] [TRT] Tactic: 9895935 time 0.020992
[06/29/2021-11:48:36] [V] [TRT] Tactic: 10223615 time 0.035756
[06/29/2021-11:48:36] [V] [TRT] Tactic: 10354687 time 0.017408
[06/29/2021-11:48:36] [V] [TRT] Tactic: 10551295 time 0.024576
[06/29/2021-11:48:36] [V] [TRT] Tactic: 10747903 time 0.017648
[06/29/2021-11:48:36] [V] [TRT] Tactic: 10944511 time 0.023004
[06/29/2021-11:48:36] [V] [TRT] Fastest Tactic: 1179647 Time: 0.016384
[06/29/2021-11:48:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (CaskConvolution)
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: 1754569683116234317 time 0.03664
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: 1825138533642645384 time 0.088832
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: 2733356012094739613 time 0.028324
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: 3915320020053085238 time 0.034692
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: 6808617066150061604 time 0.024976
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: 9091006216302412844 time 0.024352
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: -8060443123034038864 time 0.02702
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: -4420849921117327522 time 0.051432
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: -3946921629105938337 time 0.027136
[06/29/2021-11:48:36] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.024352
[06/29/2021-11:48:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (CudaConvolution)
[06/29/2021-11:48:36] [V] [TRT] Tactic: 0 time 0.02218
[06/29/2021-11:48:36] [V] [TRT] Tactic: 1 time 0.079124
[06/29/2021-11:48:36] [V] [TRT] Tactic: 2 time 0.090748
[06/29/2021-11:48:36] [V] [TRT] Tactic: 4 skipped. Scratch requested: 151552000, available: 16777216
[06/29/2021-11:48:36] [V] [TRT] Tactic: 5 time 0.096704
[06/29/2021-11:48:36] [V] [TRT] Tactic: 56 time 0.02194
[06/29/2021-11:48:36] [V] [TRT] Tactic: 57 time 0.023652
[06/29/2021-11:48:36] [V] [TRT] Tactic: 58 time 0.066304
[06/29/2021-11:48:36] [V] [TRT] Tactic: 60 skipped. Scratch requested: 151552000, available: 16777216
[06/29/2021-11:48:36] [V] [TRT] Tactic: 61 time 0.099456
[06/29/2021-11:48:36] [V] [TRT] Fastest Tactic: 56 Time: 0.02194
[06/29/2021-11:48:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[06/29/2021-11:48:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (CublasConvolution)
[06/29/2021-11:48:36] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 1179647
[06/29/2021-11:48:36] [V] [TRT] 
[06/29/2021-11:48:36] [V] [TRT] *************** Autotuning format combination: Float(128,1792,1,25088) -> Float(512,7168,1,100352) ***************
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (FusedConvActConvolution)
[06/29/2021-11:48:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (CaskConvolution)
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: 861694390046228376 time 0.048344
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: 5258189349241541167 time 0.0217
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: 5821621277990374316 time 0.033784
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: 5863767799113001648 time 0.016664
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: -9147980667639709536 time 0.034332
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: -8892196987859366827 time 0.034504
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: -8850904373104590857 time 0.054784
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: -8010679767156598961 time 0.084992
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: -7751035352149795660 time 0.03354
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: -5115676123557684531 time 0.034536
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: -493597327599791285 time 0.022012
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] Tactic: -423878181466897819 time 0.01686
[06/29/2021-11:48:36] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.016664
[06/29/2021-11:48:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (CudaConvolution)
[06/29/2021-11:48:36] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[06/29/2021-11:48:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (CublasConvolution)
[06/29/2021-11:48:36] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] 
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:36] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:36] [V] [TRT] Tactic: 1002 time 0.006904
[06/29/2021-11:48:36] [V] [TRT] Tactic: 0 time 0.006516
[06/29/2021-11:48:36] [V] [TRT] Fastest Tactic: 0 Time: 0.006516
[06/29/2021-11:48:36] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:36] [V] [TRT] Tactic: 1002 time 0.0152
[06/29/2021-11:48:36] [V] [TRT] Tactic: 0 time 0.006832
[06/29/2021-11:48:36] [V] [TRT] Fastest Tactic: 0 Time: 0.006832
[06/29/2021-11:48:36] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,200704), Float(1,14,196,100352) -> Float(1,14,196,100352) ***************
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (CaskConvolution)
[06/29/2021-11:48:36] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: 1754569683116234317 time 0.062432
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: 1825138533642645384 time 0.062236
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: 2733356012094739613 time 0.048364
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: 3915320020053085238 time 0.060672
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: 6808617066150061604 time 0.040456
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: 9091006216302412844 time 0.039936
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: -8060443123034038864 time 0.0423
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: -4420849921117327522 time 0.03968
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: -3946921629105938337 time 0.047828
[06/29/2021-11:48:37] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.03968
[06/29/2021-11:48:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (CudaConvolution)
[06/29/2021-11:48:37] [V] [TRT] Tactic: 0 time 0.041208
[06/29/2021-11:48:37] [V] [TRT] Tactic: 1 time 0.054784
[06/29/2021-11:48:37] [V] [TRT] Tactic: 2 time 0.136704
[06/29/2021-11:48:37] [V] [TRT] Tactic: 56 time 0.092416
[06/29/2021-11:48:37] [V] [TRT] Tactic: 57 time 0.098676
[06/29/2021-11:48:37] [V] [TRT] Tactic: 58 time 0.12544
[06/29/2021-11:48:37] [V] [TRT] Fastest Tactic: 0 Time: 0.041208
[06/29/2021-11:48:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (CublasConvolution)
[06/29/2021-11:48:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4420849921117327522
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:37] [V] [TRT] 
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:37] [V] [TRT] *************** Autotuning format combination: Float(256,7168,1,200704), Float(512,7168,1,100352) -> Float(512,7168,1,100352) ***************
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (CaskConvolution)
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: 861694390046228376 time 0.061688
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: 5258189349241541167 time 0.035796
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: 5821621277990374316 time 0.06016
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: 5863767799113001648 time 0.023548
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: -9147980667639709536 time 0.060416
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: -8892196987859366827 time 0.06058
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: -8850904373104590857 time 0.038564
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: -8010679767156598961 time 0.034456
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: -7751035352149795660 time 0.06016
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: -5115676123557684531 time 0.061336
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: -493597327599791285 time 0.036608
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] Tactic: -423878181466897819 time 0.024788
[06/29/2021-11:48:37] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.023548
[06/29/2021-11:48:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (CudaConvolution)
[06/29/2021-11:48:37] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (CublasConvolution)
[06/29/2021-11:48:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] 
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:37] [V] [TRT] Tactic: 1002 time 0.006096
[06/29/2021-11:48:37] [V] [TRT] Tactic: 0 time 0.0064
[06/29/2021-11:48:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.006096
[06/29/2021-11:48:37] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:37] [V] [TRT] Tactic: 1002 time 0.00604
[06/29/2021-11:48:37] [V] [TRT] Tactic: 0 time 0.0067
[06/29/2021-11:48:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.00604
[06/29/2021-11:48:37] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,25088) ***************
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:37] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:37] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:37] [V] [TRT] Tactic: 589823 time 0.170072
[06/29/2021-11:48:37] [V] [TRT] Tactic: 655359 time 0.116304
[06/29/2021-11:48:37] [V] [TRT] Tactic: 786431 time 0.048896
[06/29/2021-11:48:37] [V] [TRT] Tactic: 851967 time 0.040224
[06/29/2021-11:48:37] [V] [TRT] Tactic: 1179647 time 0.023248
[06/29/2021-11:48:37] [V] [TRT] Tactic: 1310719 time 0.08672
[06/29/2021-11:48:37] [V] [TRT] Tactic: 1376255 time 0.122312
[06/29/2021-11:48:37] [V] [TRT] Tactic: 1441791 time 0.029304
[06/29/2021-11:48:37] [V] [TRT] Tactic: 1507327 time 0.066296
[06/29/2021-11:48:37] [V] [TRT] Tactic: 1638399 time 0.027904
[06/29/2021-11:48:37] [V] [TRT] Tactic: 1835007 time 0.050308
[06/29/2021-11:48:37] [V] [TRT] Tactic: 1900543 time 0.121888
[06/29/2021-11:48:37] [V] [TRT] Tactic: 2097151 time 0.018924
[06/29/2021-11:48:37] [V] [TRT] Tactic: 2162687 time 0.125696
[06/29/2021-11:48:37] [V] [TRT] Tactic: 2293759 time 0.10678
[06/29/2021-11:48:37] [V] [TRT] Tactic: 2359295 time 0.066936
[06/29/2021-11:48:37] [V] [TRT] Tactic: 2686975 time 0.111172
[06/29/2021-11:48:37] [V] [TRT] Tactic: 3080191 time 0.057136
[06/29/2021-11:48:37] [V] [TRT] Tactic: 3342335 time 0.06648
[06/29/2021-11:48:37] [V] [TRT] Tactic: 3407871 time 0.056232
[06/29/2021-11:48:37] [V] [TRT] Tactic: 3538943 time 0.032128
[06/29/2021-11:48:37] [V] [TRT] Tactic: 3670015 time 0.215896
[06/29/2021-11:48:37] [V] [TRT] Tactic: 3932159 time 0.086296
[06/29/2021-11:48:37] [V] [TRT] Tactic: 3997695 time 0.02728
[06/29/2021-11:48:37] [V] [TRT] Tactic: 4063231 time 0.037424
[06/29/2021-11:48:37] [V] [TRT] Tactic: 4194303 time 0.041632
[06/29/2021-11:48:37] [V] [TRT] Tactic: 4259839 time 0.019696
[06/29/2021-11:48:37] [V] [TRT] Tactic: 4325375 time 0.029928
[06/29/2021-11:48:38] [V] [TRT] Tactic: 4521983 time 0.111996
[06/29/2021-11:48:38] [V] [TRT] Tactic: 4587519 time 0.02432
[06/29/2021-11:48:38] [V] [TRT] Tactic: 4653055 time 0.027896
[06/29/2021-11:48:38] [V] [TRT] Tactic: 4915199 time 0.0244
[06/29/2021-11:48:38] [V] [TRT] Tactic: 4980735 time 0.060672
[06/29/2021-11:48:38] [V] [TRT] Tactic: 5177343 time 0.022588
[06/29/2021-11:48:38] [V] [TRT] Tactic: 5242879 time 0.051712
[06/29/2021-11:48:38] [V] [TRT] Tactic: 5373951 time 0.022976
[06/29/2021-11:48:38] [V] [TRT] Tactic: 5439487 time 0.036864
[06/29/2021-11:48:38] [V] [TRT] Tactic: 5570559 time 0.064232
[06/29/2021-11:48:38] [V] [TRT] Tactic: 5636095 time 0.038544
[06/29/2021-11:48:38] [V] [TRT] Tactic: 5701631 time 0.105984
[06/29/2021-11:48:38] [V] [TRT] Tactic: 5767167 time 0.054316
[06/29/2021-11:48:38] [V] [TRT] Tactic: 5832703 time 0.05608
[06/29/2021-11:48:38] [V] [TRT] Tactic: 5898239 time 0.03668
[06/29/2021-11:48:38] [V] [TRT] Tactic: 6029311 time 0.09672
[06/29/2021-11:48:38] [V] [TRT] Tactic: 6225919 time 0.02844
[06/29/2021-11:48:38] [V] [TRT] Tactic: 6291455 time 0.022272
[06/29/2021-11:48:38] [V] [TRT] Tactic: 6422527 time 0.050212
[06/29/2021-11:48:38] [V] [TRT] Tactic: 6750207 time 0.020572
[06/29/2021-11:48:38] [V] [TRT] Tactic: 6815743 time 0.052668
[06/29/2021-11:48:38] [V] [TRT] Tactic: 6946815 time 0.045096
[06/29/2021-11:48:38] [V] [TRT] Tactic: 7012351 time 0.018944
[06/29/2021-11:48:38] [V] [TRT] Tactic: 7077887 time 0.03164
[06/29/2021-11:48:38] [V] [TRT] Tactic: 7143423 time 0.053044
[06/29/2021-11:48:38] [V] [TRT] Tactic: 7208959 time 0.056928
[06/29/2021-11:48:38] [V] [TRT] Tactic: 7340031 time 0.02854
[06/29/2021-11:48:38] [V] [TRT] Tactic: 7405567 time 0.029256
[06/29/2021-11:48:38] [V] [TRT] Tactic: 7536639 time 0.081664
[06/29/2021-11:48:38] [V] [TRT] Tactic: 7602175 time 0.042752
[06/29/2021-11:48:38] [V] [TRT] Tactic: 7733247 time 0.037596
[06/29/2021-11:48:38] [V] [TRT] Tactic: 7798783 time 0.047872
[06/29/2021-11:48:38] [V] [TRT] Tactic: 8191999 time 0.030976
[06/29/2021-11:48:38] [V] [TRT] Tactic: 8257535 time 0.026368
[06/29/2021-11:48:38] [V] [TRT] Tactic: 8323071 time 0.033524
[06/29/2021-11:48:38] [V] [TRT] Tactic: 8650751 time 0.043272
[06/29/2021-11:48:38] [V] [TRT] Tactic: 8716287 time 0.030812
[06/29/2021-11:48:38] [V] [TRT] Tactic: 9109503 time 0.019732
[06/29/2021-11:48:38] [V] [TRT] Tactic: 9568255 time 0.023552
[06/29/2021-11:48:38] [V] [TRT] Tactic: 9895935 time 0.041644
[06/29/2021-11:48:38] [V] [TRT] Tactic: 10223615 time 0.111336
[06/29/2021-11:48:38] [V] [TRT] Tactic: 10354687 time 0.0228
[06/29/2021-11:48:38] [V] [TRT] Tactic: 10551295 time 0.062324
[06/29/2021-11:48:38] [V] [TRT] Tactic: 10747903 time 0.03578
[06/29/2021-11:48:38] [V] [TRT] Tactic: 10944511 time 0.053056
[06/29/2021-11:48:38] [V] [TRT] Fastest Tactic: 2097151 Time: 0.018924
[06/29/2021-11:48:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (CaskConvolution)
[06/29/2021-11:48:38] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:38] [V] [TRT] Tactic: 1754569683116234317 time 0.109604
[06/29/2021-11:48:38] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:38] [V] [TRT] Tactic: 1825138533642645384 time 0.110744
[06/29/2021-11:48:38] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:38] [V] [TRT] Tactic: 2733356012094739613 time 0.082148
[06/29/2021-11:48:38] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:38] [V] [TRT] Tactic: 3915320020053085238 time 0.107088
[06/29/2021-11:48:38] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:38] [V] [TRT] Tactic: 6808617066150061604 time 0.067372
[06/29/2021-11:48:38] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:38] [V] [TRT] Tactic: 9091006216302412844 time 0.063744
[06/29/2021-11:48:38] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:38] [V] [TRT] Tactic: -8060443123034038864 time 0.07168
[06/29/2021-11:48:38] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:38] [V] [TRT] Tactic: -4420849921117327522 time 0.09216
[06/29/2021-11:48:38] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:38] [V] [TRT] Tactic: -3946921629105938337 time 0.080752
[06/29/2021-11:48:38] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.063744
[06/29/2021-11:48:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (CudaConvolution)
[06/29/2021-11:48:38] [V] [TRT] Tactic: 0 time 0.039508
[06/29/2021-11:48:38] [V] [TRT] Tactic: 1 time 0.080964
[06/29/2021-11:48:38] [V] [TRT] Tactic: 2 time 0.129192
[06/29/2021-11:48:38] [V] [TRT] Tactic: 4 skipped. Scratch requested: 152436736, available: 16777216
[06/29/2021-11:48:38] [V] [TRT] Tactic: 5 time 0.126056
[06/29/2021-11:48:38] [V] [TRT] Tactic: 56 time 0.040612
[06/29/2021-11:48:39] [V] [TRT] Tactic: 57 time 0.071064
[06/29/2021-11:48:39] [V] [TRT] Tactic: 58 time 0.142132
[06/29/2021-11:48:39] [V] [TRT] Tactic: 60 skipped. Scratch requested: 152436736, available: 16777216
[06/29/2021-11:48:39] [V] [TRT] Tactic: 61 time 0.125752
[06/29/2021-11:48:39] [V] [TRT] Fastest Tactic: 0 Time: 0.039508
[06/29/2021-11:48:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (CublasConvolution)
[06/29/2021-11:48:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2097151
[06/29/2021-11:48:39] [V] [TRT] 
[06/29/2021-11:48:39] [V] [TRT] *************** Autotuning format combination: Float(512,7168,1,100352) -> Float(128,1792,1,25088) ***************
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (CaskConvolution)
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: 861694390046228376 time 0.112124
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: 5258189349241541167 time 0.060404
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: 5821621277990374316 time 0.107892
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: 5863767799113001648 time 0.036368
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -9147980667639709536 time 0.107788
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -8892196987859366827 time 0.109284
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -8850904373104590857 time 0.060972
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -8010679767156598961 time 0.03788
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -7751035352149795660 time 0.107008
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -5115676123557684531 time 0.108308
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -493597327599791285 time 0.067176
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -423878181466897819 time 0.03724
[06/29/2021-11:48:39] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.036368
[06/29/2021-11:48:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (CudaConvolution)
[06/29/2021-11:48:39] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (CublasConvolution)
[06/29/2021-11:48:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] 
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,25088) -> Float(1,14,196,25088) ***************
[06/29/2021-11:48:39] [V] [TRT] *************** Autotuning format combination: Float(128,1792,1,25088) -> Float(128,1792,1,25088) ***************
[06/29/2021-11:48:39] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,25088), Float(1,14,196,100352) -> Float(1,14,196,100352) ***************
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (CaskConvolution)
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: 1754569683116234317 time 0.038376
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: 1825138533642645384 time 0.039116
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: 2733356012094739613 time 0.045572
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: 3915320020053085238 time 0.037104
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: 6808617066150061604 time 0.02518
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: 9091006216302412844 time 0.027816
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -8060443123034038864 time 0.028928
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -4420849921117327522 time 0.025092
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -3946921629105938337 time 0.029184
[06/29/2021-11:48:39] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.025092
[06/29/2021-11:48:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (CudaConvolution)
[06/29/2021-11:48:39] [V] [TRT] Tactic: 0 time 0.039848
[06/29/2021-11:48:39] [V] [TRT] Tactic: 1 time 0.032188
[06/29/2021-11:48:39] [V] [TRT] Tactic: 2 time 0.077312
[06/29/2021-11:48:39] [V] [TRT] Tactic: 4 skipped. Scratch requested: 151552000, available: 16777216
[06/29/2021-11:48:39] [V] [TRT] Tactic: 5 time 0.160232
[06/29/2021-11:48:39] [V] [TRT] Tactic: 56 time 0.030976
[06/29/2021-11:48:39] [V] [TRT] Tactic: 57 time 0.041988
[06/29/2021-11:48:39] [V] [TRT] Tactic: 58 time 0.103608
[06/29/2021-11:48:39] [V] [TRT] Tactic: 60 skipped. Scratch requested: 151552000, available: 16777216
[06/29/2021-11:48:39] [V] [TRT] Tactic: 61 time 0.107492
[06/29/2021-11:48:39] [V] [TRT] Fastest Tactic: 56 Time: 0.030976
[06/29/2021-11:48:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (CublasConvolution)
[06/29/2021-11:48:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4420849921117327522
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:39] [V] [TRT] 
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:39] [V] [TRT] *************** Autotuning format combination: Float(128,1792,1,25088), Float(512,7168,1,100352) -> Float(512,7168,1,100352) ***************
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (CaskConvolution)
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: 861694390046228376 time 0.037424
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: 5258189349241541167 time 0.024348
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: 5821621277990374316 time 0.035012
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: 5863767799113001648 time 0.018332
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -9147980667639709536 time 0.036748
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -8892196987859366827 time 0.03796
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -8850904373104590857 time 0.023924
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -8010679767156598961 time 0.019712
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -7751035352149795660 time 0.034676
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -5115676123557684531 time 0.035712
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -493597327599791285 time 0.02484
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -423878181466897819 time 0.018604
[06/29/2021-11:48:39] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.018332
[06/29/2021-11:48:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (CudaConvolution)
[06/29/2021-11:48:39] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (CublasConvolution)
[06/29/2021-11:48:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] 
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:39] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,25088) ***************
[06/29/2021-11:48:39] [V] [TRT] *************** Autotuning format combination: Float(512,7168,1,100352) -> Float(128,1792,1,25088) ***************
[06/29/2021-11:48:39] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,25088) -> Float(1,14,196,25088) ***************
[06/29/2021-11:48:39] [V] [TRT] *************** Autotuning format combination: Float(128,1792,1,25088) -> Float(128,1792,1,25088) ***************
[06/29/2021-11:48:39] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,25088), Float(1,14,196,100352) -> Float(1,14,196,100352) ***************
[06/29/2021-11:48:39] [V] [TRT] *************** Autotuning format combination: Float(128,1792,1,25088), Float(512,7168,1,100352) -> Float(512,7168,1,100352) ***************
[06/29/2021-11:48:39] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,14,196,25088) ***************
[06/29/2021-11:48:39] [V] [TRT] *************** Autotuning format combination: Float(512,7168,1,100352) -> Float(128,1792,1,25088) ***************
[06/29/2021-11:48:39] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,25088) -> Float(1,14,196,25088) ***************
[06/29/2021-11:48:39] [V] [TRT] *************** Autotuning format combination: Float(128,1792,1,25088) -> Float(128,1792,1,25088) ***************
[06/29/2021-11:48:39] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,25088), Float(1,14,196,100352) -> Float(1,14,196,100352) ***************
[06/29/2021-11:48:39] [V] [TRT] *************** Autotuning format combination: Float(128,1792,1,25088), Float(512,7168,1,100352) -> Float(512,7168,1,100352) ***************
[06/29/2021-11:48:39] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,100352) -> Float(1,7,49,12544) ***************
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (CaskConvolution)
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: 1754569683116234317 time 0.11012
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: 1825138533642645384 time 0.200724
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: 2733356012094739613 time 0.08378
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: 3915320020053085238 time 0.169252
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: 6808617066150061604 time 0.0676
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: 9091006216302412844 time 0.094976
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -8060443123034038864 time 0.07278
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -4420849921117327522 time 0.06388
[06/29/2021-11:48:39] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:39] [V] [TRT] Tactic: -3946921629105938337 time 0.113376
[06/29/2021-11:48:39] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.06388
[06/29/2021-11:48:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (CudaConvolution)
[06/29/2021-11:48:39] [V] [TRT] Tactic: 0 time 0.042668
[06/29/2021-11:48:39] [V] [TRT] Tactic: 1 time 0.072524
[06/29/2021-11:48:39] [V] [TRT] Tactic: 2 time 0.129724
[06/29/2021-11:48:39] [V] [TRT] Tactic: 56 time 0.040488
[06/29/2021-11:48:39] [V] [TRT] Tactic: 57 time 0.0448
[06/29/2021-11:48:40] [V] [TRT] Tactic: 58 time 0.212224
[06/29/2021-11:48:40] [V] [TRT] Fastest Tactic: 56 Time: 0.040488
[06/29/2021-11:48:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (CublasConvolution)
[06/29/2021-11:48:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 56
[06/29/2021-11:48:40] [V] [TRT] 
[06/29/2021-11:48:40] [V] [TRT] *************** Autotuning format combination: Float(512,7168,1,100352) -> Float(256,1792,1,12544) ***************
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (CaskConvolution)
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] Tactic: 861694390046228376 time 0.10844
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] Tactic: 5258189349241541167 time 0.059232
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] Tactic: 5821621277990374316 time 0.10736
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] Tactic: 5863767799113001648 time 0.041728
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] Tactic: -9147980667639709536 time 0.109216
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] Tactic: -8892196987859366827 time 0.113924
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] Tactic: -8850904373104590857 time 0.061384
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] Tactic: -8010679767156598961 time 0.03822
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] Tactic: -7751035352149795660 time 0.163608
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] Tactic: -5115676123557684531 time 0.107776
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] Tactic: -493597327599791285 time 0.115532
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] Tactic: -423878181466897819 time 0.038792
[06/29/2021-11:48:40] [V] [TRT] Fastest Tactic: -8010679767156598961 Time: 0.03822
[06/29/2021-11:48:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (CudaConvolution)
[06/29/2021-11:48:40] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (CublasConvolution)
[06/29/2021-11:48:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8010679767156598961
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] 
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:40] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:40] [V] [TRT] Tactic: 1002 time 0.005376
[06/29/2021-11:48:40] [V] [TRT] Tactic: 0 time 0.005548
[06/29/2021-11:48:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.005376
[06/29/2021-11:48:40] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:40] [V] [TRT] Tactic: 1002 time 0.005492
[06/29/2021-11:48:40] [V] [TRT] Tactic: 0 time 0.00544
[06/29/2021-11:48:40] [V] [TRT] Fastest Tactic: 0 Time: 0.00544
[06/29/2021-11:48:40] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,12544) -> Float(1,7,49,12544) ***************
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:40] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:40] [V] [TRT] Tactic: 524287 time 0.272876
[06/29/2021-11:48:40] [V] [TRT] Tactic: 720895 time 0.150016
[06/29/2021-11:48:40] [V] [TRT] Tactic: 983039 time 0.105984
[06/29/2021-11:48:40] [V] [TRT] Tactic: 1048575 time 0.115564
[06/29/2021-11:48:40] [V] [TRT] Tactic: 1703935 time 0.059972
[06/29/2021-11:48:40] [V] [TRT] Tactic: 1769471 time 0.074304
[06/29/2021-11:48:40] [V] [TRT] Tactic: 1966079 time 0.561384
[06/29/2021-11:48:40] [V] [TRT] Tactic: 2031615 time 0.25032
[06/29/2021-11:48:40] [V] [TRT] Tactic: 2228223 time 0.186752
[06/29/2021-11:48:40] [V] [TRT] Tactic: 2424831 time 0.05242
[06/29/2021-11:48:40] [V] [TRT] Tactic: 2621439 time 0.048384
[06/29/2021-11:48:40] [V] [TRT] Tactic: 2752511 time 0.166444
[06/29/2021-11:48:40] [V] [TRT] Tactic: 2818047 time 0.158804
[06/29/2021-11:48:40] [V] [TRT] Tactic: 2883583 time 0.619264
[06/29/2021-11:48:40] [V] [TRT] Tactic: 3014655 time 0.074224
[06/29/2021-11:48:40] [V] [TRT] Tactic: 3145727 time 0.143116
[06/29/2021-11:48:40] [V] [TRT] Tactic: 3473407 time 0.186644
[06/29/2021-11:48:40] [V] [TRT] Tactic: 3604479 time 0.105252
[06/29/2021-11:48:40] [V] [TRT] Tactic: 3735551 time 0.129616
[06/29/2021-11:48:40] [V] [TRT] Tactic: 4390911 time 0.592584
[06/29/2021-11:48:40] [V] [TRT] Tactic: 5046271 time 0.091904
[06/29/2021-11:48:40] [V] [TRT] Tactic: 5963775 time 0.53376
[06/29/2021-11:48:40] [V] [TRT] Tactic: 6160383 time 0.15366
[06/29/2021-11:48:40] [V] [TRT] Tactic: 6488063 time 0.216864
[06/29/2021-11:48:40] [V] [TRT] Tactic: 6881279 time 0.22784
[06/29/2021-11:48:40] [V] [TRT] Tactic: 7274495 time 0.048384
[06/29/2021-11:48:40] [V] [TRT] Tactic: 7864319 time 0.051712
[06/29/2021-11:48:40] [V] [TRT] Tactic: 7995391 time 0.24914
[06/29/2021-11:48:40] [V] [TRT] Tactic: 8585215 time 0.206608
[06/29/2021-11:48:40] [V] [TRT] Tactic: 8847359 time 0.055564
[06/29/2021-11:48:40] [V] [TRT] Tactic: 8978431 time 0.271868
[06/29/2021-11:48:40] [V] [TRT] Tactic: 9043967 time 0.069008
[06/29/2021-11:48:40] [V] [TRT] Tactic: 9175039 time 0.08128
[06/29/2021-11:48:40] [V] [TRT] Tactic: 9502719 time 0.32128
[06/29/2021-11:48:40] [V] [TRT] Tactic: 9830399 time 0.14336
[06/29/2021-11:48:40] [V] [TRT] Tactic: 9961471 time 0.058628
[06/29/2021-11:48:40] [V] [TRT] Tactic: 10027007 time 0.104636
[06/29/2021-11:48:40] [V] [TRT] Tactic: 10092543 time 0.320068
[06/29/2021-11:48:40] [V] [TRT] Tactic: 10289151 time 0.29972
[06/29/2021-11:48:40] [V] [TRT] Tactic: 10485759 time 0.05504
[06/29/2021-11:48:41] [V] [TRT] Tactic: 10682367 time 0.048944
[06/29/2021-11:48:41] [V] [TRT] Tactic: 10813439 time 0.080408
[06/29/2021-11:48:41] [V] [TRT] Fastest Tactic: 2621439 Time: 0.048384
[06/29/2021-11:48:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (CaskConvolution)
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:41] [V] [TRT] Tactic: 1825138533642645384 time 0.459264
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[06/29/2021-11:48:41] [V] [TRT] Tactic: 2775507031594384867 time 0.06786
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[06/29/2021-11:48:41] [V] [TRT] Tactic: 2842488832350522458 time 0.301576
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:41] [V] [TRT] Tactic: 3915320020053085238 time 0.444928
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[06/29/2021-11:48:41] [V] [TRT] Tactic: 6448355332020552203 time 0.469416
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:41] [V] [TRT] Tactic: 6808617066150061604 time 0.265392
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:41] [V] [TRT] Tactic: -8060443123034038864 time 0.31232
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:41] [V] [TRT] Tactic: -4420849921117327522 time 0.287896
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:41] [V] [TRT] Tactic: -3946921629105938337 time 0.310852
[06/29/2021-11:48:41] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.06786
[06/29/2021-11:48:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (CudaConvolution)
[06/29/2021-11:48:41] [V] [TRT] Tactic: 0 time 0.138412
[06/29/2021-11:48:41] [V] [TRT] Tactic: 1 time 0.159488
[06/29/2021-11:48:41] [V] [TRT] Tactic: 2 time 0.150528
[06/29/2021-11:48:41] [V] [TRT] Tactic: 4 skipped. Scratch requested: 153944064, available: 16777216
[06/29/2021-11:48:41] [V] [TRT] Tactic: 5 skipped. Scratch requested: 287440896, available: 16777216
[06/29/2021-11:48:41] [V] [TRT] Tactic: 6 time 0.085248
[06/29/2021-11:48:41] [V] [TRT] Tactic: 56 time 0.13824
[06/29/2021-11:48:41] [V] [TRT] Tactic: 57 time 0.159488
[06/29/2021-11:48:41] [V] [TRT] Tactic: 58 time 0.150388
[06/29/2021-11:48:41] [V] [TRT] Tactic: 60 skipped. Scratch requested: 153944064, available: 16777216
[06/29/2021-11:48:41] [V] [TRT] Tactic: 61 skipped. Scratch requested: 287440896, available: 16777216
[06/29/2021-11:48:41] [V] [TRT] Tactic: 62 time 0.085024
[06/29/2021-11:48:41] [V] [TRT] Fastest Tactic: 62 Time: 0.085024
[06/29/2021-11:48:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (CublasConvolution)
[06/29/2021-11:48:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2621439
[06/29/2021-11:48:41] [V] [TRT] 
[06/29/2021-11:48:41] [V] [TRT] *************** Autotuning format combination: Float(256,1792,1,12544) -> Float(256,1792,1,12544) ***************
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (CaskConvolution)
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] Tactic: 861694390046228376 time 0.449292
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] Tactic: 1017870653102653567 time 0.458124
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] Tactic: 5258189349241541167 time 0.238592
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] Tactic: 5821621277990374316 time 0.44672
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] Tactic: 5863767799113001648 time 0.130152
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] Tactic: -9147980667639709536 time 0.461544
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] Tactic: -8850904373104590857 time 0.243608
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] Tactic: -7751035352149795660 time 0.44678
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] Tactic: -3853827649136781465 time 0.460052
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] Tactic: -3263369460438823196 time 0.2436
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] Tactic: -423878181466897819 time 0.133116
[06/29/2021-11:48:41] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.130152
[06/29/2021-11:48:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (CudaConvolution)
[06/29/2021-11:48:41] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (CublasConvolution)
[06/29/2021-11:48:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] 
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:41] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,12544) -> Float(1,7,49,50176) ***************
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:41] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (FusedConvActConvolution)
[06/29/2021-11:48:41] [V] [TRT] Tactic: 589823 time 0.08856
[06/29/2021-11:48:41] [V] [TRT] Tactic: 655359 time 0.060636
[06/29/2021-11:48:41] [V] [TRT] Tactic: 786431 time 0.029964
[06/29/2021-11:48:41] [V] [TRT] Tactic: 851967 time 0.024512
[06/29/2021-11:48:41] [V] [TRT] Tactic: 1179647 time 0.016892
[06/29/2021-11:48:41] [V] [TRT] Tactic: 1310719 time 0.047104
[06/29/2021-11:48:41] [V] [TRT] Tactic: 1376255 time 0.064364
[06/29/2021-11:48:41] [V] [TRT] Tactic: 1441791 time 0.019712
[06/29/2021-11:48:41] [V] [TRT] Tactic: 1507327 time 0.036352
[06/29/2021-11:48:41] [V] [TRT] Tactic: 1638399 time 0.020224
[06/29/2021-11:48:41] [V] [TRT] Tactic: 1835007 time 0.029952
[06/29/2021-11:48:41] [V] [TRT] Tactic: 1900543 time 0.06652
[06/29/2021-11:48:41] [V] [TRT] Tactic: 2097151 time 0.014388
[06/29/2021-11:48:41] [V] [TRT] Tactic: 2162687 time 0.066048
[06/29/2021-11:48:41] [V] [TRT] Tactic: 2293759 time 0.05632
[06/29/2021-11:48:41] [V] [TRT] Tactic: 2359295 time 0.037884
[06/29/2021-11:48:41] [V] [TRT] Tactic: 2686975 time 0.059648
[06/29/2021-11:48:41] [V] [TRT] Tactic: 3080191 time 0.032792
[06/29/2021-11:48:41] [V] [TRT] Tactic: 3342335 time 0.038352
[06/29/2021-11:48:41] [V] [TRT] Tactic: 3407871 time 0.032512
[06/29/2021-11:48:41] [V] [TRT] Tactic: 3538943 time 0.020092
[06/29/2021-11:48:41] [V] [TRT] Tactic: 3670015 time 0.111616
[06/29/2021-11:48:41] [V] [TRT] Tactic: 3932159 time 0.046304
[06/29/2021-11:48:41] [V] [TRT] Tactic: 3997695 time 0.020736
[06/29/2021-11:48:41] [V] [TRT] Tactic: 4063231 time 0.023932
[06/29/2021-11:48:41] [V] [TRT] Tactic: 4194303 time 0.0256
[06/29/2021-11:48:41] [V] [TRT] Tactic: 4259839 time 0.015616
[06/29/2021-11:48:42] [V] [TRT] Tactic: 4325375 time 0.019764
[06/29/2021-11:48:42] [V] [TRT] Tactic: 4521983 time 0.059648
[06/29/2021-11:48:42] [V] [TRT] Tactic: 4587519 time 0.017892
[06/29/2021-11:48:42] [V] [TRT] Tactic: 4653055 time 0.017832
[06/29/2021-11:48:42] [V] [TRT] Tactic: 4915199 time 0.017728
[06/29/2021-11:48:42] [V] [TRT] Tactic: 4980735 time 0.03192
[06/29/2021-11:48:42] [V] [TRT] Tactic: 5177343 time 0.016732
[06/29/2021-11:48:42] [V] [TRT] Tactic: 5242879 time 0.030184
[06/29/2021-11:48:42] [V] [TRT] Tactic: 5373951 time 0.01792
[06/29/2021-11:48:42] [V] [TRT] Tactic: 5439487 time 0.02234
[06/29/2021-11:48:42] [V] [TRT] Tactic: 5570559 time 0.036864
[06/29/2021-11:48:42] [V] [TRT] Tactic: 5636095 time 0.024808
[06/29/2021-11:48:42] [V] [TRT] Tactic: 5701631 time 0.056832
[06/29/2021-11:48:42] [V] [TRT] Tactic: 5767167 time 0.030272
[06/29/2021-11:48:42] [V] [TRT] Tactic: 5832703 time 0.03328
[06/29/2021-11:48:42] [V] [TRT] Tactic: 5898239 time 0.01792
[06/29/2021-11:48:42] [V] [TRT] Tactic: 6029311 time 0.051556
[06/29/2021-11:48:42] [V] [TRT] Tactic: 6225919 time 0.019164
[06/29/2021-11:48:42] [V] [TRT] Tactic: 6291455 time 0.016928
[06/29/2021-11:48:42] [V] [TRT] Tactic: 6422527 time 0.029592
[06/29/2021-11:48:42] [V] [TRT] Tactic: 6750207 time 0.01792
[06/29/2021-11:48:42] [V] [TRT] Tactic: 6815743 time 0.03128
[06/29/2021-11:48:42] [V] [TRT] Tactic: 6946815 time 0.026296
[06/29/2021-11:48:42] [V] [TRT] Tactic: 7012351 time 0.0144
[06/29/2021-11:48:42] [V] [TRT] Tactic: 7077887 time 0.021248
[06/29/2021-11:48:42] [V] [TRT] Tactic: 7143423 time 0.029904
[06/29/2021-11:48:42] [V] [TRT] Tactic: 7208959 time 0.032368
[06/29/2021-11:48:42] [V] [TRT] Tactic: 7340031 time 0.018688
[06/29/2021-11:48:42] [V] [TRT] Tactic: 7405567 time 0.019692
[06/29/2021-11:48:42] [V] [TRT] Tactic: 7536639 time 0.045784
[06/29/2021-11:48:42] [V] [TRT] Tactic: 7602175 time 0.026832
[06/29/2021-11:48:42] [V] [TRT] Tactic: 7733247 time 0.022096
[06/29/2021-11:48:42] [V] [TRT] Tactic: 7798783 time 0.029756
[06/29/2021-11:48:42] [V] [TRT] Tactic: 8191999 time 0.022164
[06/29/2021-11:48:42] [V] [TRT] Tactic: 8257535 time 0.01944
[06/29/2021-11:48:42] [V] [TRT] Tactic: 8323071 time 0.022532
[06/29/2021-11:48:42] [V] [TRT] Tactic: 8650751 time 0.02614
[06/29/2021-11:48:42] [V] [TRT] Tactic: 8716287 time 0.02172
[06/29/2021-11:48:42] [V] [TRT] Tactic: 9109503 time 0.015852
[06/29/2021-11:48:42] [V] [TRT] Tactic: 9568255 time 0.016792
[06/29/2021-11:48:42] [V] [TRT] Tactic: 9895935 time 0.026312
[06/29/2021-11:48:42] [V] [TRT] Tactic: 10223615 time 0.058788
[06/29/2021-11:48:42] [V] [TRT] Tactic: 10354687 time 0.016776
[06/29/2021-11:48:42] [V] [TRT] Tactic: 10551295 time 0.035996
[06/29/2021-11:48:42] [V] [TRT] Tactic: 10747903 time 0.021504
[06/29/2021-11:48:42] [V] [TRT] Tactic: 10944511 time 0.031232
[06/29/2021-11:48:42] [V] [TRT] Fastest Tactic: 2097151 Time: 0.014388
[06/29/2021-11:48:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (CaskConvolution)
[06/29/2021-11:48:42] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:42] [V] [TRT] Tactic: 1754569683116234317 time 0.060416
[06/29/2021-11:48:42] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:42] [V] [TRT] Tactic: 1825138533642645384 time 0.061896
[06/29/2021-11:48:42] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:42] [V] [TRT] Tactic: 2733356012094739613 time 0.04494
[06/29/2021-11:48:42] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:42] [V] [TRT] Tactic: 3915320020053085238 time 0.05888
[06/29/2021-11:48:42] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:42] [V] [TRT] Tactic: 6808617066150061604 time 0.038424
[06/29/2021-11:48:42] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:42] [V] [TRT] Tactic: 9091006216302412844 time 0.039168
[06/29/2021-11:48:42] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:42] [V] [TRT] Tactic: -8060443123034038864 time 0.041536
[06/29/2021-11:48:42] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:42] [V] [TRT] Tactic: -4420849921117327522 time 0.03702
[06/29/2021-11:48:42] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:42] [V] [TRT] Tactic: -3946921629105938337 time 0.044344
[06/29/2021-11:48:42] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.03702
[06/29/2021-11:48:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (CudaConvolution)
[06/29/2021-11:48:42] [V] [TRT] Tactic: 0 time 0.025212
[06/29/2021-11:48:42] [V] [TRT] Tactic: 1 time 0.026972
[06/29/2021-11:48:42] [V] [TRT] Tactic: 2 time 0.107096
[06/29/2021-11:48:42] [V] [TRT] Tactic: 4 skipped. Scratch requested: 605618176, available: 16777216
[06/29/2021-11:48:42] [V] [TRT] Tactic: 5 skipped. Scratch requested: 36870144, available: 16777216
[06/29/2021-11:48:42] [V] [TRT] Tactic: 56 time 0.025276
[06/29/2021-11:48:43] [V] [TRT] Tactic: 57 time 0.026788
[06/29/2021-11:48:43] [V] [TRT] Tactic: 58 time 0.106988
[06/29/2021-11:48:43] [V] [TRT] Tactic: 60 skipped. Scratch requested: 605618176, available: 16777216
[06/29/2021-11:48:43] [V] [TRT] Tactic: 61 skipped. Scratch requested: 36870144, available: 16777216
[06/29/2021-11:48:43] [V] [TRT] Fastest Tactic: 0 Time: 0.025212
[06/29/2021-11:48:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[06/29/2021-11:48:43] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (CublasConvolution)
[06/29/2021-11:48:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2097151
[06/29/2021-11:48:43] [V] [TRT] 
[06/29/2021-11:48:43] [V] [TRT] *************** Autotuning format combination: Float(256,1792,1,12544) -> Float(1024,7168,1,50176) ***************
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (FusedConvActConvolution)
[06/29/2021-11:48:43] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (CaskConvolution)
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: 861694390046228376 time 0.059816
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: 5258189349241541167 time 0.034048
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: 5821621277990374316 time 0.057916
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: 5863767799113001648 time 0.02218
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: -9147980667639709536 time 0.060268
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: -8892196987859366827 time 0.060328
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: -8850904373104590857 time 0.037316
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: -8010679767156598961 time 0.024064
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: -7751035352149795660 time 0.057656
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: -5115676123557684531 time 0.06016
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: -493597327599791285 time 0.03416
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: -423878181466897819 time 0.02408
[06/29/2021-11:48:43] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.02218
[06/29/2021-11:48:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (CudaConvolution)
[06/29/2021-11:48:43] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[06/29/2021-11:48:43] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (CublasConvolution)
[06/29/2021-11:48:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] 
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:43] [V] [TRT] Tactic: 1002 time 0.005552
[06/29/2021-11:48:43] [V] [TRT] Tactic: 0 time 0.005984
[06/29/2021-11:48:43] [V] [TRT] Fastest Tactic: 1002 Time: 0.005552
[06/29/2021-11:48:43] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:43] [V] [TRT] Tactic: 1002 time 0.0087
[06/29/2021-11:48:43] [V] [TRT] Tactic: 0 time 0.006508
[06/29/2021-11:48:43] [V] [TRT] Fastest Tactic: 0 Time: 0.006508
[06/29/2021-11:48:43] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,100352), Float(1,7,49,50176) -> Float(1,7,49,50176) ***************
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (CaskConvolution)
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: 1754569683116234317 time 0.11096
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: 1825138533642645384 time 0.1115
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: 2733356012094739613 time 0.082204
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: 3915320020053085238 time 0.109864
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: 6808617066150061604 time 0.068128
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: 9091006216302412844 time 0.068356
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: -8060443123034038864 time 0.073004
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: -4420849921117327522 time 0.064768
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: -3946921629105938337 time 0.082632
[06/29/2021-11:48:43] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.064768
[06/29/2021-11:48:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (CudaConvolution)
[06/29/2021-11:48:43] [V] [TRT] Tactic: 0 time 0.048384
[06/29/2021-11:48:43] [V] [TRT] Tactic: 1 time 0.065792
[06/29/2021-11:48:43] [V] [TRT] Tactic: 2 time 0.128704
[06/29/2021-11:48:43] [V] [TRT] Tactic: 56 time 0.04822
[06/29/2021-11:48:43] [V] [TRT] Tactic: 57 time 0.06016
[06/29/2021-11:48:43] [V] [TRT] Tactic: 58 time 0.12864
[06/29/2021-11:48:43] [V] [TRT] Fastest Tactic: 56 Time: 0.04822
[06/29/2021-11:48:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (CublasConvolution)
[06/29/2021-11:48:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 56
[06/29/2021-11:48:43] [V] [TRT] 
[06/29/2021-11:48:43] [V] [TRT] *************** Autotuning format combination: Float(512,7168,1,100352), Float(1024,7168,1,50176) -> Float(1024,7168,1,50176) ***************
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (CaskConvolution)
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: 861694390046228376 time 0.110096
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: 5258189349241541167 time 0.061156
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: 5821621277990374316 time 0.1085
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: 5863767799113001648 time 0.036576
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: -9147980667639709536 time 0.109156
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: -8892196987859366827 time 0.109568
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: -8850904373104590857 time 0.06258
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: -8010679767156598961 time 0.038292
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: -7751035352149795660 time 0.108544
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: -5115676123557684531 time 0.109092
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: -493597327599791285 time 0.061488
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] Tactic: -423878181466897819 time 0.039424
[06/29/2021-11:48:43] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.036576
[06/29/2021-11:48:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (CudaConvolution)
[06/29/2021-11:48:43] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (CublasConvolution)
[06/29/2021-11:48:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] 
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:43] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:43] [V] [TRT] Tactic: 1002 time 0.006364
[06/29/2021-11:48:43] [V] [TRT] Tactic: 0 time 0.006144
[06/29/2021-11:48:43] [V] [TRT] Fastest Tactic: 0 Time: 0.006144
[06/29/2021-11:48:43] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:43] [V] [TRT] Tactic: 1002 time 0.006396
[06/29/2021-11:48:43] [V] [TRT] Tactic: 0 time 0.005408
[06/29/2021-11:48:43] [V] [TRT] Fastest Tactic: 0 Time: 0.005408
[06/29/2021-11:48:43] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,12544) ***************
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:43] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:43] [V] [TRT] Tactic: 589823 time 0.331948
[06/29/2021-11:48:43] [V] [TRT] Tactic: 655359 time 0.21976
[06/29/2021-11:48:43] [V] [TRT] Tactic: 786431 time 0.09008
[06/29/2021-11:48:43] [V] [TRT] Tactic: 851967 time 0.06804
[06/29/2021-11:48:43] [V] [TRT] Tactic: 1179647 time 0.037164
[06/29/2021-11:48:43] [V] [TRT] Tactic: 1310719 time 0.165376
[06/29/2021-11:48:43] [V] [TRT] Tactic: 1376255 time 0.233836
[06/29/2021-11:48:43] [V] [TRT] Tactic: 1441791 time 0.051184
[06/29/2021-11:48:43] [V] [TRT] Tactic: 1507327 time 0.120032
[06/29/2021-11:48:43] [V] [TRT] Tactic: 1638399 time 0.047328
[06/29/2021-11:48:44] [V] [TRT] Tactic: 1835007 time 0.092556
[06/29/2021-11:48:44] [V] [TRT] Tactic: 1900543 time 0.23314
[06/29/2021-11:48:44] [V] [TRT] Tactic: 2097151 time 0.028256
[06/29/2021-11:48:44] [V] [TRT] Tactic: 2162687 time 0.242772
[06/29/2021-11:48:44] [V] [TRT] Tactic: 2293759 time 0.204544
[06/29/2021-11:48:44] [V] [TRT] Tactic: 2359295 time 0.125724
[06/29/2021-11:48:44] [V] [TRT] Tactic: 2686975 time 0.21352
[06/29/2021-11:48:44] [V] [TRT] Tactic: 3080191 time 0.10498
[06/29/2021-11:48:44] [V] [TRT] Tactic: 3342335 time 0.121976
[06/29/2021-11:48:44] [V] [TRT] Tactic: 3407871 time 0.105216
[06/29/2021-11:48:44] [V] [TRT] Tactic: 3538943 time 0.056208
[06/29/2021-11:48:44] [V] [TRT] Tactic: 3670015 time 0.420548
[06/29/2021-11:48:44] [V] [TRT] Tactic: 3932159 time 0.163584
[06/29/2021-11:48:44] [V] [TRT] Tactic: 3997695 time 0.04812
[06/29/2021-11:48:44] [V] [TRT] Tactic: 4063231 time 0.070832
[06/29/2021-11:48:44] [V] [TRT] Tactic: 4194303 time 0.075024
[06/29/2021-11:48:44] [V] [TRT] Tactic: 4259839 time 0.032936
[06/29/2021-11:48:44] [V] [TRT] Tactic: 4325375 time 0.053968
[06/29/2021-11:48:44] [V] [TRT] Tactic: 4521983 time 0.214784
[06/29/2021-11:48:44] [V] [TRT] Tactic: 4587519 time 0.04158
[06/29/2021-11:48:44] [V] [TRT] Tactic: 4653055 time 0.045872
[06/29/2021-11:48:44] [V] [TRT] Tactic: 4915199 time 0.040616
[06/29/2021-11:48:44] [V] [TRT] Tactic: 4980735 time 0.100608
[06/29/2021-11:48:44] [V] [TRT] Tactic: 5177343 time 0.038152
[06/29/2021-11:48:44] [V] [TRT] Tactic: 5242879 time 0.09586
[06/29/2021-11:48:44] [V] [TRT] Tactic: 5373951 time 0.037388
[06/29/2021-11:48:44] [V] [TRT] Tactic: 5439487 time 0.059864
[06/29/2021-11:48:44] [V] [TRT] Tactic: 5570559 time 0.11776
[06/29/2021-11:48:44] [V] [TRT] Tactic: 5636095 time 0.064256
[06/29/2021-11:48:44] [V] [TRT] Tactic: 5701631 time 0.203432
[06/29/2021-11:48:44] [V] [TRT] Tactic: 5767167 time 0.092372
[06/29/2021-11:48:44] [V] [TRT] Tactic: 5832703 time 0.107008
[06/29/2021-11:48:44] [V] [TRT] Tactic: 5898239 time 0.048136
[06/29/2021-11:48:44] [V] [TRT] Tactic: 6029311 time 0.190964
[06/29/2021-11:48:44] [V] [TRT] Tactic: 6225919 time 0.050476
[06/29/2021-11:48:44] [V] [TRT] Tactic: 6291455 time 0.037428
[06/29/2021-11:48:44] [V] [TRT] Tactic: 6422527 time 0.093184
[06/29/2021-11:48:44] [V] [TRT] Tactic: 6750207 time 0.033432
[06/29/2021-11:48:44] [V] [TRT] Tactic: 6815743 time 0.096056
[06/29/2021-11:48:44] [V] [TRT] Tactic: 6946815 time 0.078112
[06/29/2021-11:48:44] [V] [TRT] Tactic: 7012351 time 0.02816
[06/29/2021-11:48:44] [V] [TRT] Tactic: 7077887 time 0.057468
[06/29/2021-11:48:44] [V] [TRT] Tactic: 7143423 time 0.092568
[06/29/2021-11:48:44] [V] [TRT] Tactic: 7208959 time 0.107512
[06/29/2021-11:48:44] [V] [TRT] Tactic: 7340031 time 0.049316
[06/29/2021-11:48:44] [V] [TRT] Tactic: 7405567 time 0.051232
[06/29/2021-11:48:44] [V] [TRT] Tactic: 7536639 time 0.1544
[06/29/2021-11:48:44] [V] [TRT] Tactic: 7602175 time 0.076544
[06/29/2021-11:48:44] [V] [TRT] Tactic: 7733247 time 0.066048
[06/29/2021-11:48:44] [V] [TRT] Tactic: 7798783 time 0.090112
[06/29/2021-11:48:44] [V] [TRT] Tactic: 8191999 time 0.051816
[06/29/2021-11:48:44] [V] [TRT] Tactic: 8257535 time 0.04456
[06/29/2021-11:48:44] [V] [TRT] Tactic: 8323071 time 0.058948
[06/29/2021-11:48:44] [V] [TRT] Tactic: 8650751 time 0.07808
[06/29/2021-11:48:44] [V] [TRT] Tactic: 8716287 time 0.0559
[06/29/2021-11:48:44] [V] [TRT] Tactic: 9109503 time 0.031176
[06/29/2021-11:48:44] [V] [TRT] Tactic: 9568255 time 0.041544
[06/29/2021-11:48:45] [V] [TRT] Tactic: 9895935 time 0.075008
[06/29/2021-11:48:45] [V] [TRT] Tactic: 10223615 time 0.213496
[06/29/2021-11:48:45] [V] [TRT] Tactic: 10354687 time 0.038164
[06/29/2021-11:48:45] [V] [TRT] Tactic: 10551295 time 0.114884
[06/29/2021-11:48:45] [V] [TRT] Tactic: 10747903 time 0.064256
[06/29/2021-11:48:45] [V] [TRT] Tactic: 10944511 time 0.099904
[06/29/2021-11:48:45] [V] [TRT] Fastest Tactic: 7012351 Time: 0.02816
[06/29/2021-11:48:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (CaskConvolution)
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: 1754569683116234317 time 0.205432
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: 1825138533642645384 time 0.207428
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: 2733356012094739613 time 0.148992
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: 3915320020053085238 time 0.20352
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: 6808617066150061604 time 0.123956
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: 9091006216302412844 time 0.142592
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: -8060443123034038864 time 0.131724
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: -4420849921117327522 time 0.119732
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: -3946921629105938337 time 0.151296
[06/29/2021-11:48:45] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.119732
[06/29/2021-11:48:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (CudaConvolution)
[06/29/2021-11:48:45] [V] [TRT] Tactic: 0 time 0.066464
[06/29/2021-11:48:45] [V] [TRT] Tactic: 1 time 0.07022
[06/29/2021-11:48:45] [V] [TRT] Tactic: 2 time 0.143888
[06/29/2021-11:48:45] [V] [TRT] Tactic: 4 skipped. Scratch requested: 607387648, available: 16777216
[06/29/2021-11:48:45] [V] [TRT] Tactic: 5 skipped. Scratch requested: 36870144, available: 16777216
[06/29/2021-11:48:45] [V] [TRT] Tactic: 56 time 0.06634
[06/29/2021-11:48:45] [V] [TRT] Tactic: 57 time 0.070288
[06/29/2021-11:48:45] [V] [TRT] Tactic: 58 time 0.144632
[06/29/2021-11:48:45] [V] [TRT] Tactic: 60 skipped. Scratch requested: 607387648, available: 16777216
[06/29/2021-11:48:45] [V] [TRT] Tactic: 61 skipped. Scratch requested: 36870144, available: 16777216
[06/29/2021-11:48:45] [V] [TRT] Fastest Tactic: 56 Time: 0.06634
[06/29/2021-11:48:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (CublasConvolution)
[06/29/2021-11:48:45] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7012351
[06/29/2021-11:48:45] [V] [TRT] 
[06/29/2021-11:48:45] [V] [TRT] *************** Autotuning format combination: Float(1024,7168,1,50176) -> Float(256,1792,1,12544) ***************
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:45] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (CaskConvolution)
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: 861694390046228376 time 0.306432
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: 5258189349241541167 time 0.111168
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: 5821621277990374316 time 0.203204
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: 5863767799113001648 time 0.062184
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: -9147980667639709536 time 0.203924
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: -8892196987859366827 time 0.204544
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: -8850904373104590857 time 0.1134
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: -8010679767156598961 time 0.063484
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: -7751035352149795660 time 0.204288
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: -5115676123557684531 time 0.204044
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: -493597327599791285 time 0.108832
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: -423878181466897819 time 0.063588
[06/29/2021-11:48:45] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.062184
[06/29/2021-11:48:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (CudaConvolution)
[06/29/2021-11:48:45] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (CublasConvolution)
[06/29/2021-11:48:45] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] 
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,12544) -> Float(1,7,49,12544) ***************
[06/29/2021-11:48:45] [V] [TRT] *************** Autotuning format combination: Float(256,1792,1,12544) -> Float(256,1792,1,12544) ***************
[06/29/2021-11:48:45] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,12544), Float(1,7,49,50176) -> Float(1,7,49,50176) ***************
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (CaskConvolution)
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: 1754569683116234317 time 0.061696
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: 1825138533642645384 time 0.062348
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: 2733356012094739613 time 0.060156
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: 3915320020053085238 time 0.061248
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: 6808617066150061604 time 0.039344
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: 9091006216302412844 time 0.040192
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: -8060443123034038864 time 0.042736
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: -4420849921117327522 time 0.038228
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: -3946921629105938337 time 0.045496
[06/29/2021-11:48:45] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.038228
[06/29/2021-11:48:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (CudaConvolution)
[06/29/2021-11:48:45] [V] [TRT] Tactic: 0 time 0.031236
[06/29/2021-11:48:45] [V] [TRT] Tactic: 1 time 0.033792
[06/29/2021-11:48:45] [V] [TRT] Tactic: 2 time 0.115456
[06/29/2021-11:48:45] [V] [TRT] Tactic: 4 skipped. Scratch requested: 605618176, available: 16777216
[06/29/2021-11:48:45] [V] [TRT] Tactic: 5 skipped. Scratch requested: 36870144, available: 16777216
[06/29/2021-11:48:45] [V] [TRT] Tactic: 56 time 0.032896
[06/29/2021-11:48:45] [V] [TRT] Tactic: 57 time 0.046848
[06/29/2021-11:48:45] [V] [TRT] Tactic: 58 time 0.114688
[06/29/2021-11:48:45] [V] [TRT] Tactic: 60 skipped. Scratch requested: 605618176, available: 16777216
[06/29/2021-11:48:45] [V] [TRT] Tactic: 61 skipped. Scratch requested: 36870144, available: 16777216
[06/29/2021-11:48:45] [V] [TRT] Fastest Tactic: 0 Time: 0.031236
[06/29/2021-11:48:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (CublasConvolution)
[06/29/2021-11:48:45] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0
[06/29/2021-11:48:45] [V] [TRT] 
[06/29/2021-11:48:45] [V] [TRT] *************** Autotuning format combination: Float(256,1792,1,12544), Float(1024,7168,1,50176) -> Float(1024,7168,1,50176) ***************
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (CaskConvolution)
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: 861694390046228376 time 0.061588
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: 5258189349241541167 time 0.036096
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: 5821621277990374316 time 0.059604
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: 5863767799113001648 time 0.02304
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: -9147980667639709536 time 0.060036
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: -8892196987859366827 time 0.059988
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: -8850904373104590857 time 0.037444
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: -8010679767156598961 time 0.024
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: -7751035352149795660 time 0.059648
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:45] [V] [TRT] Tactic: -5115676123557684531 time 0.06002
[06/29/2021-11:48:45] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: -493597327599791285 time 0.0363
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: -423878181466897819 time 0.0241
[06/29/2021-11:48:46] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.02304
[06/29/2021-11:48:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (CudaConvolution)
[06/29/2021-11:48:46] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (CublasConvolution)
[06/29/2021-11:48:46] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] 
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,12544) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(1024,7168,1,50176) -> Float(256,1792,1,12544) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,12544) -> Float(1,7,49,12544) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(256,1792,1,12544) -> Float(256,1792,1,12544) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,12544), Float(1,7,49,50176) -> Float(1,7,49,50176) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(256,1792,1,12544), Float(1024,7168,1,50176) -> Float(1024,7168,1,50176) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,12544) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(1024,7168,1,50176) -> Float(256,1792,1,12544) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,12544) -> Float(1,7,49,12544) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(256,1792,1,12544) -> Float(256,1792,1,12544) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,12544), Float(1,7,49,50176) -> Float(1,7,49,50176) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(256,1792,1,12544), Float(1024,7168,1,50176) -> Float(1024,7168,1,50176) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,12544) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(1024,7168,1,50176) -> Float(256,1792,1,12544) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,12544) -> Float(1,7,49,12544) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(256,1792,1,12544) -> Float(256,1792,1,12544) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,12544), Float(1,7,49,50176) -> Float(1,7,49,50176) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(256,1792,1,12544), Float(1024,7168,1,50176) -> Float(1024,7168,1,50176) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,7,49,12544) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(1024,7168,1,50176) -> Float(256,1792,1,12544) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,12544) -> Float(1,7,49,12544) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(256,1792,1,12544) -> Float(256,1792,1,12544) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,12544), Float(1,7,49,50176) -> Float(1,7,49,50176) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(256,1792,1,12544), Float(1024,7168,1,50176) -> Float(1024,7168,1,50176) ***************
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,50176) -> Float(1,4,16,8192) ***************
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:46] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (CaskConvolution)
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: 1754569683116234317 time 0.205032
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: 1825138533642645384 time 0.207896
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: 2733356012094739613 time 0.147772
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: 3915320020053085238 time 0.204724
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: 6808617066150061604 time 0.124004
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: 9091006216302412844 time 0.122624
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: -8060443123034038864 time 0.13352
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: -4420849921117327522 time 0.119808
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: -3946921629105938337 time 0.1507
[06/29/2021-11:48:46] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.119808
[06/29/2021-11:48:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (CudaConvolution)
[06/29/2021-11:48:46] [V] [TRT] Tactic: 0 time 0.066048
[06/29/2021-11:48:46] [V] [TRT] Tactic: 1 time 0.084152
[06/29/2021-11:48:46] [V] [TRT] Tactic: 2 time 0.14592
[06/29/2021-11:48:46] [V] [TRT] Tactic: 56 time 0.06572
[06/29/2021-11:48:46] [V] [TRT] Tactic: 57 time 0.083532
[06/29/2021-11:48:46] [V] [TRT] Tactic: 58 time 0.145152
[06/29/2021-11:48:46] [V] [TRT] Fastest Tactic: 56 Time: 0.06572
[06/29/2021-11:48:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (CublasConvolution)
[06/29/2021-11:48:46] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 56
[06/29/2021-11:48:46] [V] [TRT] 
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(1024,7168,1,50176) -> Float(512,2048,1,8192) ***************
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:46] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (CaskConvolution)
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: 861694390046228376 time 0.2056
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: 5258189349241541167 time 0.111764
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: 5821621277990374316 time 0.203984
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: 5863767799113001648 time 0.06208
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: -9147980667639709536 time 0.204204
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: -8892196987859366827 time 0.21886
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: -8850904373104590857 time 0.114176
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: -8010679767156598961 time 0.063548
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: -7751035352149795660 time 0.204044
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: -5115676123557684531 time 0.203808
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: -493597327599791285 time 0.109828
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] Tactic: -423878181466897819 time 0.064256
[06/29/2021-11:48:46] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.06208
[06/29/2021-11:48:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (CudaConvolution)
[06/29/2021-11:48:46] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (CublasConvolution)
[06/29/2021-11:48:46] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] 
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:46] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:46] [V] [TRT] Tactic: 1002 time 0.006144
[06/29/2021-11:48:46] [V] [TRT] Tactic: 0 time 0.00452
[06/29/2021-11:48:46] [V] [TRT] Fastest Tactic: 0 Time: 0.00452
[06/29/2021-11:48:46] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:46] [V] [TRT] Tactic: 1002 time 0.005184
[06/29/2021-11:48:46] [V] [TRT] Tactic: 0 time 0.004096
[06/29/2021-11:48:46] [V] [TRT] Fastest Tactic: 0 Time: 0.004096
[06/29/2021-11:48:46] [V] [TRT] *************** Autotuning format combination: Float(1,4,16,8192) -> Float(1,4,16,8192) ***************
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:46] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:46] [V] [TRT] Tactic: 524287 time 0.415744
[06/29/2021-11:48:46] [V] [TRT] Tactic: 720895 time 0.326872
[06/29/2021-11:48:46] [V] [TRT] Tactic: 983039 time 0.159208
[06/29/2021-11:48:46] [V] [TRT] Tactic: 1048575 time 0.261376
[06/29/2021-11:48:46] [V] [TRT] Tactic: 1703935 time 0.134656
[06/29/2021-11:48:46] [V] [TRT] Tactic: 1769471 time 0.145408
[06/29/2021-11:48:46] [V] [TRT] Tactic: 1966079 time 0.667132
[06/29/2021-11:48:46] [V] [TRT] Tactic: 2031615 time 0.568632
[06/29/2021-11:48:46] [V] [TRT] Tactic: 2228223 time 0.266744
[06/29/2021-11:48:46] [V] [TRT] Tactic: 2424831 time 0.098788
[06/29/2021-11:48:46] [V] [TRT] Tactic: 2621439 time 0.098844
[06/29/2021-11:48:46] [V] [TRT] Tactic: 2752511 time 0.359516
[06/29/2021-11:48:46] [V] [TRT] Tactic: 2818047 time 0.323244
[06/29/2021-11:48:47] [V] [TRT] Tactic: 2883583 time 0.782812
[06/29/2021-11:48:47] [V] [TRT] Tactic: 3014655 time 0.161868
[06/29/2021-11:48:47] [V] [TRT] Tactic: 3145727 time 0.1856
[06/29/2021-11:48:47] [V] [TRT] Tactic: 3473407 time 0.396288
[06/29/2021-11:48:47] [V] [TRT] Tactic: 3604479 time 0.164864
[06/29/2021-11:48:47] [V] [TRT] Tactic: 3735551 time 0.320936
[06/29/2021-11:48:47] [V] [TRT] Tactic: 4390911 time 0.709632
[06/29/2021-11:48:47] [V] [TRT] Tactic: 5046271 time 0.216684
[06/29/2021-11:48:47] [V] [TRT] Tactic: 5963775 time 0.609732
[06/29/2021-11:48:47] [V] [TRT] Tactic: 6160383 time 0.337152
[06/29/2021-11:48:47] [V] [TRT] Tactic: 6488063 time 0.299212
[06/29/2021-11:48:47] [V] [TRT] Tactic: 6881279 time 0.511188
[06/29/2021-11:48:47] [V] [TRT] Tactic: 7274495 time 0.099584
[06/29/2021-11:48:47] [V] [TRT] Tactic: 7864319 time 0.103936
[06/29/2021-11:48:47] [V] [TRT] Tactic: 7995391 time 0.33792
[06/29/2021-11:48:47] [V] [TRT] Tactic: 8585215 time 0.466688
[06/29/2021-11:48:47] [V] [TRT] Tactic: 8847359 time 0.108288
[06/29/2021-11:48:47] [V] [TRT] Tactic: 8978431 time 0.611328
[06/29/2021-11:48:47] [V] [TRT] Tactic: 9043967 time 0.148812
[06/29/2021-11:48:47] [V] [TRT] Tactic: 9175039 time 0.16154
[06/29/2021-11:48:47] [V] [TRT] Tactic: 9502719 time 0.716588
[06/29/2021-11:48:47] [V] [TRT] Tactic: 9830399 time 0.314524
[06/29/2021-11:48:47] [V] [TRT] Tactic: 9961471 time 0.113564
[06/29/2021-11:48:47] [V] [TRT] Tactic: 10027007 time 0.24064
[06/29/2021-11:48:47] [V] [TRT] Tactic: 10092543 time 0.70912
[06/29/2021-11:48:47] [V] [TRT] Tactic: 10289151 time 0.66564
[06/29/2021-11:48:47] [V] [TRT] Tactic: 10485759 time 0.124272
[06/29/2021-11:48:47] [V] [TRT] Tactic: 10682367 time 0.096224
[06/29/2021-11:48:47] [V] [TRT] Tactic: 10813439 time 0.181188
[06/29/2021-11:48:47] [V] [TRT] Fastest Tactic: 10682367 Time: 0.096224
[06/29/2021-11:48:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (CaskConvolution)
[06/29/2021-11:48:47] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:47] [V] [TRT] Tactic: 1825138533642645384 time 1.01451
[06/29/2021-11:48:47] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1
[06/29/2021-11:48:47] [V] [TRT] Tactic: 2775507031594384867 time 0.127348
[06/29/2021-11:48:47] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1
[06/29/2021-11:48:47] [V] [TRT] Tactic: 2842488832350522458 time 0.727036
[06/29/2021-11:48:47] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:47] [V] [TRT] Tactic: 3915320020053085238 time 0.88074
[06/29/2021-11:48:47] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1
[06/29/2021-11:48:47] [V] [TRT] Tactic: 6448355332020552203 time 1.02092
[06/29/2021-11:48:47] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:47] [V] [TRT] Tactic: 6808617066150061604 time 0.623872
[06/29/2021-11:48:47] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:47] [V] [TRT] Tactic: -8060443123034038864 time 0.625652
[06/29/2021-11:48:47] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:47] [V] [TRT] Tactic: -4420849921117327522 time 0.616448
[06/29/2021-11:48:47] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:47] [V] [TRT] Tactic: -3946921629105938337 time 0.675024
[06/29/2021-11:48:47] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.127348
[06/29/2021-11:48:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (CudaConvolution)
[06/29/2021-11:48:47] [V] [TRT] Tactic: 0 time 0.311052
[06/29/2021-11:48:47] [V] [TRT] Tactic: 1 time 0.409872
[06/29/2021-11:48:47] [V] [TRT] Tactic: 2 time 0.30542
[06/29/2021-11:48:47] [V] [TRT] Tactic: 4 skipped. Scratch requested: 614596608, available: 16777216
[06/29/2021-11:48:47] [V] [TRT] Tactic: 5 skipped. Scratch requested: 1145307136, available: 16777216
[06/29/2021-11:48:47] [V] [TRT] Tactic: 6 skipped. Scratch requested: 26216448, available: 16777216
[06/29/2021-11:48:48] [V] [TRT] Tactic: 56 time 0.409156
[06/29/2021-11:48:48] [V] [TRT] Tactic: 57 time 0.31128
[06/29/2021-11:48:48] [V] [TRT] Tactic: 58 time 0.401088
[06/29/2021-11:48:48] [V] [TRT] Tactic: 60 skipped. Scratch requested: 614596608, available: 16777216
[06/29/2021-11:48:48] [V] [TRT] Tactic: 61 skipped. Scratch requested: 1145307136, available: 16777216
[06/29/2021-11:48:48] [V] [TRT] Tactic: 62 skipped. Scratch requested: 26216448, available: 16777216
[06/29/2021-11:48:48] [V] [TRT] Fastest Tactic: 2 Time: 0.30542
[06/29/2021-11:48:48] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:48] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:48] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (CublasConvolution)
[06/29/2021-11:48:48] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10682367
[06/29/2021-11:48:48] [V] [TRT] 
[06/29/2021-11:48:48] [V] [TRT] *************** Autotuning format combination: Float(512,2048,1,8192) -> Float(512,2048,1,8192) ***************
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:48] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:48] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (CaskConvolution)
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] Tactic: 861694390046228376 time 0.98804
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] Tactic: 1017870653102653567 time 1.00404
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] Tactic: 5258189349241541167 time 0.469392
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] Tactic: 5821621277990374316 time 0.88282
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] Tactic: 5863767799113001648 time 0.250892
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] Tactic: -9147980667639709536 time 0.930304
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] Tactic: -8850904373104590857 time 0.476116
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] Tactic: -7751035352149795660 time 0.88372
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] Tactic: -3853827649136781465 time 0.90368
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] Tactic: -3263369460438823196 time 0.475136
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] Tactic: -423878181466897819 time 0.2627
[06/29/2021-11:48:48] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.250892
[06/29/2021-11:48:48] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (CudaConvolution)
[06/29/2021-11:48:48] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:48] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:48] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:48] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (CublasConvolution)
[06/29/2021-11:48:48] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] 
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:48] [V] [TRT] *************** Autotuning format combination: Float(1,4,16,8192) -> Float(1,4,16,32768) ***************
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:48] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:48] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (FusedConvActConvolution)
[06/29/2021-11:48:48] [V] [TRT] Tactic: 589823 time 0.169452
[06/29/2021-11:48:48] [V] [TRT] Tactic: 655359 time 0.110348
[06/29/2021-11:48:48] [V] [TRT] Tactic: 786431 time 0.047816
[06/29/2021-11:48:48] [V] [TRT] Tactic: 851967 time 0.0402
[06/29/2021-11:48:48] [V] [TRT] Tactic: 1179647 time 0.022444
[06/29/2021-11:48:48] [V] [TRT] Tactic: 1310719 time 0.12744
[06/29/2021-11:48:48] [V] [TRT] Tactic: 1376255 time 0.12356
[06/29/2021-11:48:48] [V] [TRT] Tactic: 1441791 time 0.028928
[06/29/2021-11:48:48] [V] [TRT] Tactic: 1507327 time 0.065152
[06/29/2021-11:48:48] [V] [TRT] Tactic: 1638399 time 0.032904
[06/29/2021-11:48:48] [V] [TRT] Tactic: 1835007 time 0.048676
[06/29/2021-11:48:48] [V] [TRT] Tactic: 1900543 time 0.157256
[06/29/2021-11:48:48] [V] [TRT] Tactic: 2097151 time 0.019968
[06/29/2021-11:48:48] [V] [TRT] Tactic: 2162687 time 0.122592
[06/29/2021-11:48:48] [V] [TRT] Tactic: 2293759 time 0.104848
[06/29/2021-11:48:48] [V] [TRT] Tactic: 2359295 time 0.072788
[06/29/2021-11:48:48] [V] [TRT] Tactic: 2686975 time 0.110268
[06/29/2021-11:48:48] [V] [TRT] Tactic: 3080191 time 0.055028
[06/29/2021-11:48:48] [V] [TRT] Tactic: 3342335 time 0.06656
[06/29/2021-11:48:48] [V] [TRT] Tactic: 3407871 time 0.056316
[06/29/2021-11:48:48] [V] [TRT] Tactic: 3538943 time 0.032908
[06/29/2021-11:48:48] [V] [TRT] Tactic: 3670015 time 0.331036
[06/29/2021-11:48:48] [V] [TRT] Tactic: 3932159 time 0.084956
[06/29/2021-11:48:48] [V] [TRT] Tactic: 3997695 time 0.027756
[06/29/2021-11:48:48] [V] [TRT] Tactic: 4063231 time 0.03584
[06/29/2021-11:48:48] [V] [TRT] Tactic: 4194303 time 0.04172
[06/29/2021-11:48:48] [V] [TRT] Tactic: 4259839 time 0.021248
[06/29/2021-11:48:48] [V] [TRT] Tactic: 4325375 time 0.03328
[06/29/2021-11:48:48] [V] [TRT] Tactic: 4521983 time 0.11136
[06/29/2021-11:48:48] [V] [TRT] Tactic: 4587519 time 0.03226
[06/29/2021-11:48:48] [V] [TRT] Tactic: 4653055 time 0.027904
[06/29/2021-11:48:49] [V] [TRT] Tactic: 4915199 time 0.026268
[06/29/2021-11:48:49] [V] [TRT] Tactic: 4980735 time 0.054344
[06/29/2021-11:48:49] [V] [TRT] Tactic: 5177343 time 0.022784
[06/29/2021-11:48:49] [V] [TRT] Tactic: 5242879 time 0.052112
[06/29/2021-11:48:49] [V] [TRT] Tactic: 5373951 time 0.023636
[06/29/2021-11:48:49] [V] [TRT] Tactic: 5439487 time 0.035
[06/29/2021-11:48:49] [V] [TRT] Tactic: 5570559 time 0.062316
[06/29/2021-11:48:49] [V] [TRT] Tactic: 5636095 time 0.035584
[06/29/2021-11:48:49] [V] [TRT] Tactic: 5701631 time 0.104012
[06/29/2021-11:48:49] [V] [TRT] Tactic: 5767167 time 0.049756
[06/29/2021-11:48:49] [V] [TRT] Tactic: 5832703 time 0.057032
[06/29/2021-11:48:49] [V] [TRT] Tactic: 5898239 time 0.026912
[06/29/2021-11:48:49] [V] [TRT] Tactic: 6029311 time 0.094208
[06/29/2021-11:48:49] [V] [TRT] Tactic: 6225919 time 0.029484
[06/29/2021-11:48:49] [V] [TRT] Tactic: 6291455 time 0.022384
[06/29/2021-11:48:49] [V] [TRT] Tactic: 6422527 time 0.050576
[06/29/2021-11:48:49] [V] [TRT] Tactic: 6750207 time 0.02176
[06/29/2021-11:48:49] [V] [TRT] Tactic: 6815743 time 0.053504
[06/29/2021-11:48:49] [V] [TRT] Tactic: 6946815 time 0.043352
[06/29/2021-11:48:49] [V] [TRT] Tactic: 7012351 time 0.019396
[06/29/2021-11:48:49] [V] [TRT] Tactic: 7077887 time 0.034856
[06/29/2021-11:48:49] [V] [TRT] Tactic: 7143423 time 0.053344
[06/29/2021-11:48:49] [V] [TRT] Tactic: 7208959 time 0.056164
[06/29/2021-11:48:49] [V] [TRT] Tactic: 7340031 time 0.028476
[06/29/2021-11:48:49] [V] [TRT] Tactic: 7405567 time 0.028924
[06/29/2021-11:48:49] [V] [TRT] Tactic: 7536639 time 0.079872
[06/29/2021-11:48:49] [V] [TRT] Tactic: 7602175 time 0.044288
[06/29/2021-11:48:49] [V] [TRT] Tactic: 7733247 time 0.037112
[06/29/2021-11:48:49] [V] [TRT] Tactic: 7798783 time 0.047924
[06/29/2021-11:48:49] [V] [TRT] Tactic: 8191999 time 0.031232
[06/29/2021-11:48:49] [V] [TRT] Tactic: 8257535 time 0.025848
[06/29/2021-11:48:49] [V] [TRT] Tactic: 8323071 time 0.034012
[06/29/2021-11:48:49] [V] [TRT] Tactic: 8650751 time 0.041488
[06/29/2021-11:48:49] [V] [TRT] Tactic: 8716287 time 0.031688
[06/29/2021-11:48:49] [V] [TRT] Tactic: 9109503 time 0.021248
[06/29/2021-11:48:49] [V] [TRT] Tactic: 9568255 time 0.025076
[06/29/2021-11:48:49] [V] [TRT] Tactic: 9895935 time 0.042824
[06/29/2021-11:48:49] [V] [TRT] Tactic: 10223615 time 0.152172
[06/29/2021-11:48:49] [V] [TRT] Tactic: 10354687 time 0.023736
[06/29/2021-11:48:49] [V] [TRT] Tactic: 10551295 time 0.062168
[06/29/2021-11:48:49] [V] [TRT] Tactic: 10747903 time 0.034424
[06/29/2021-11:48:49] [V] [TRT] Tactic: 10944511 time 0.054484
[06/29/2021-11:48:49] [V] [TRT] Fastest Tactic: 7012351 Time: 0.019396
[06/29/2021-11:48:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (CaskConvolution)
[06/29/2021-11:48:49] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:49] [V] [TRT] Tactic: 1754569683116234317 time 0.117248
[06/29/2021-11:48:49] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:49] [V] [TRT] Tactic: 1825138533642645384 time 0.110844
[06/29/2021-11:48:49] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:49] [V] [TRT] Tactic: 2733356012094739613 time 0.081664
[06/29/2021-11:48:49] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:49] [V] [TRT] Tactic: 3915320020053085238 time 0.108288
[06/29/2021-11:48:49] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:49] [V] [TRT] Tactic: 6808617066150061604 time 0.068
[06/29/2021-11:48:49] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:49] [V] [TRT] Tactic: 9091006216302412844 time 0.06776
[06/29/2021-11:48:49] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:49] [V] [TRT] Tactic: -8060443123034038864 time 0.072272
[06/29/2021-11:48:49] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:49] [V] [TRT] Tactic: -4420849921117327522 time 0.066032
[06/29/2021-11:48:49] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:49] [V] [TRT] Tactic: -3946921629105938337 time 0.081836
[06/29/2021-11:48:49] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.066032
[06/29/2021-11:48:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (CudaConvolution)
[06/29/2021-11:48:49] [V] [TRT] Tactic: 0 time 0.038928
[06/29/2021-11:48:49] [V] [TRT] Tactic: 1 time 0.06686
[06/29/2021-11:48:49] [V] [TRT] Tactic: 2 time 0.11964
[06/29/2021-11:48:49] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2421293056, available: 16777216
[06/29/2021-11:48:49] [V] [TRT] Tactic: 5 skipped. Scratch requested: 143998976, available: 16777216
[06/29/2021-11:48:50] [V] [TRT] Tactic: 56 time 0.03772
[06/29/2021-11:48:50] [V] [TRT] Tactic: 57 time 0.055688
[06/29/2021-11:48:50] [V] [TRT] Tactic: 58 time 0.120024
[06/29/2021-11:48:50] [V] [TRT] Tactic: 60 skipped. Scratch requested: 2421293056, available: 16777216
[06/29/2021-11:48:50] [V] [TRT] Tactic: 61 skipped. Scratch requested: 143998976, available: 16777216
[06/29/2021-11:48:50] [V] [TRT] Fastest Tactic: 56 Time: 0.03772
[06/29/2021-11:48:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[06/29/2021-11:48:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (CublasConvolution)
[06/29/2021-11:48:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7012351
[06/29/2021-11:48:50] [V] [TRT] 
[06/29/2021-11:48:50] [V] [TRT] *************** Autotuning format combination: Float(512,2048,1,8192) -> Float(2048,8192,1,32768) ***************
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (FusedConvActConvolution)
[06/29/2021-11:48:50] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (CaskConvolution)
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: 861694390046228376 time 0.109312
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: 5258189349241541167 time 0.061104
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: 5821621277990374316 time 0.107176
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: 5863767799113001648 time 0.037704
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: -9147980667639709536 time 0.108748
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: -8892196987859366827 time 0.109808
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: -8850904373104590857 time 0.06256
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: -8010679767156598961 time 0.03832
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: -7751035352149795660 time 0.107112
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: -5115676123557684531 time 0.108872
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: -493597327599791285 time 0.060276
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: -423878181466897819 time 0.03978
[06/29/2021-11:48:50] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.037704
[06/29/2021-11:48:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (CudaConvolution)
[06/29/2021-11:48:50] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (CudaDepthwiseConvolution)
[06/29/2021-11:48:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (CublasConvolution)
[06/29/2021-11:48:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] 
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:50] [V] [TRT] Tactic: 1002 time 0.0053
[06/29/2021-11:48:50] [V] [TRT] Tactic: 0 time 0.005032
[06/29/2021-11:48:50] [V] [TRT] Fastest Tactic: 0 Time: 0.005032
[06/29/2021-11:48:50] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:50] [V] [TRT] Tactic: 1002 time 0.005136
[06/29/2021-11:48:50] [V] [TRT] Tactic: 0 time 0.005244
[06/29/2021-11:48:50] [V] [TRT] Fastest Tactic: 1002 Time: 0.005136
[06/29/2021-11:48:50] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,50176), Float(1,4,16,32768) -> Float(1,4,16,32768) ***************
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (CaskConvolution)
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: 1754569683116234317 time 0.208208
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: 1825138533642645384 time 0.210448
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: 2733356012094739613 time 0.1856
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: 3915320020053085238 time 0.20772
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: 6808617066150061604 time 0.127236
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: 9091006216302412844 time 0.124928
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: -8060443123034038864 time 0.135512
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: -4420849921117327522 time 0.178668
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: -3946921629105938337 time 0.187904
[06/29/2021-11:48:50] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.124928
[06/29/2021-11:48:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (CudaConvolution)
[06/29/2021-11:48:50] [V] [TRT] Tactic: 0 time 0.09064
[06/29/2021-11:48:50] [V] [TRT] Tactic: 1 time 0.089704
[06/29/2021-11:48:50] [V] [TRT] Tactic: 2 time 0.196608
[06/29/2021-11:48:50] [V] [TRT] Tactic: 56 time 0.091136
[06/29/2021-11:48:50] [V] [TRT] Tactic: 57 time 0.089128
[06/29/2021-11:48:50] [V] [TRT] Tactic: 58 time 0.34176
[06/29/2021-11:48:50] [V] [TRT] Fastest Tactic: 57 Time: 0.089128
[06/29/2021-11:48:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (CublasConvolution)
[06/29/2021-11:48:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 57
[06/29/2021-11:48:50] [V] [TRT] 
[06/29/2021-11:48:50] [V] [TRT] *************** Autotuning format combination: Float(1024,7168,1,50176), Float(2048,8192,1,32768) -> Float(2048,8192,1,32768) ***************
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (CaskConvolution)
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: 861694390046228376 time 0.20864
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: 5258189349241541167 time 0.113232
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: 5821621277990374316 time 0.213016
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: 5863767799113001648 time 0.066816
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: -9147980667639709536 time 0.208252
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: -8892196987859366827 time 0.313856
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: -8850904373104590857 time 0.115456
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: -8010679767156598961 time 0.065804
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: -7751035352149795660 time 0.207476
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: -5115676123557684531 time 0.30992
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: -493597327599791285 time 0.113412
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] Tactic: -423878181466897819 time 0.06744
[06/29/2021-11:48:50] [V] [TRT] Fastest Tactic: -8010679767156598961 Time: 0.065804
[06/29/2021-11:48:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (CudaConvolution)
[06/29/2021-11:48:50] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (CublasConvolution)
[06/29/2021-11:48:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8010679767156598961
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] 
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:50] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:50] [V] [TRT] Tactic: 1002 time 0.00512
[06/29/2021-11:48:50] [V] [TRT] Tactic: 0 time 0.006144
[06/29/2021-11:48:50] [V] [TRT] Fastest Tactic: 1002 Time: 0.00512
[06/29/2021-11:48:50] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:50] [V] [TRT] Tactic: 1002 time 0.005616
[06/29/2021-11:48:50] [V] [TRT] Tactic: 0 time 0.005648
[06/29/2021-11:48:50] [V] [TRT] Fastest Tactic: 1002 Time: 0.005616
[06/29/2021-11:48:50] [V] [TRT] *************** Autotuning format combination: Float(1,4,16,32768) -> Float(1,4,16,8192) ***************
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:50] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:50] [V] [TRT] Tactic: 589823 time 0.653568
[06/29/2021-11:48:51] [V] [TRT] Tactic: 655359 time 0.55812
[06/29/2021-11:48:51] [V] [TRT] Tactic: 786431 time 0.172428
[06/29/2021-11:48:51] [V] [TRT] Tactic: 851967 time 0.118992
[06/29/2021-11:48:51] [V] [TRT] Tactic: 1179647 time 0.06674
[06/29/2021-11:48:51] [V] [TRT] Tactic: 1310719 time 0.321964
[06/29/2021-11:48:51] [V] [TRT] Tactic: 1376255 time 0.457996
[06/29/2021-11:48:51] [V] [TRT] Tactic: 1441791 time 0.09216
[06/29/2021-11:48:51] [V] [TRT] Tactic: 1507327 time 0.22946
[06/29/2021-11:48:51] [V] [TRT] Tactic: 1638399 time 0.086272
[06/29/2021-11:48:51] [V] [TRT] Tactic: 1835007 time 0.176376
[06/29/2021-11:48:51] [V] [TRT] Tactic: 1900543 time 0.449676
[06/29/2021-11:48:51] [V] [TRT] Tactic: 2097151 time 0.04926
[06/29/2021-11:48:51] [V] [TRT] Tactic: 2162687 time 0.469748
[06/29/2021-11:48:51] [V] [TRT] Tactic: 2293759 time 0.400836
[06/29/2021-11:48:51] [V] [TRT] Tactic: 2359295 time 0.242436
[06/29/2021-11:48:51] [V] [TRT] Tactic: 2686975 time 0.418816
[06/29/2021-11:48:51] [V] [TRT] Tactic: 3080191 time 0.199032
[06/29/2021-11:48:51] [V] [TRT] Tactic: 3342335 time 0.2304
[06/29/2021-11:48:51] [V] [TRT] Tactic: 3407871 time 0.212328
[06/29/2021-11:48:51] [V] [TRT] Tactic: 3538943 time 0.140332
[06/29/2021-11:48:51] [V] [TRT] Tactic: 3670015 time 0.858112
[06/29/2021-11:48:51] [V] [TRT] Tactic: 3932159 time 0.339152
[06/29/2021-11:48:51] [V] [TRT] Tactic: 3997695 time 0.089128
[06/29/2021-11:48:51] [V] [TRT] Tactic: 4063231 time 0.119396
[06/29/2021-11:48:51] [V] [TRT] Tactic: 4194303 time 0.14368
[06/29/2021-11:48:51] [V] [TRT] Tactic: 4259839 time 0.064112
[06/29/2021-11:48:51] [V] [TRT] Tactic: 4325375 time 0.106012
[06/29/2021-11:48:51] [V] [TRT] Tactic: 4521983 time 0.866816
[06/29/2021-11:48:51] [V] [TRT] Tactic: 4587519 time 0.078292
[06/29/2021-11:48:51] [V] [TRT] Tactic: 4653055 time 0.083748
[06/29/2021-11:48:51] [V] [TRT] Tactic: 4915199 time 0.07758
[06/29/2021-11:48:51] [V] [TRT] Tactic: 4980735 time 0.194324
[06/29/2021-11:48:51] [V] [TRT] Tactic: 5177343 time 0.067328
[06/29/2021-11:48:51] [V] [TRT] Tactic: 5242879 time 0.192796
[06/29/2021-11:48:51] [V] [TRT] Tactic: 5373951 time 0.066816
[06/29/2021-11:48:51] [V] [TRT] Tactic: 5439487 time 0.117516
[06/29/2021-11:48:51] [V] [TRT] Tactic: 5570559 time 0.222092
[06/29/2021-11:48:51] [V] [TRT] Tactic: 5636095 time 0.114112
[06/29/2021-11:48:51] [V] [TRT] Tactic: 5701631 time 0.41254
[06/29/2021-11:48:51] [V] [TRT] Tactic: 5767167 time 0.366052
[06/29/2021-11:48:51] [V] [TRT] Tactic: 5832703 time 0.213204
[06/29/2021-11:48:51] [V] [TRT] Tactic: 5898239 time 0.088328
[06/29/2021-11:48:51] [V] [TRT] Tactic: 6029311 time 0.35968
[06/29/2021-11:48:51] [V] [TRT] Tactic: 6225919 time 0.09468
[06/29/2021-11:48:51] [V] [TRT] Tactic: 6291455 time 0.076032
[06/29/2021-11:48:51] [V] [TRT] Tactic: 6422527 time 0.176024
[06/29/2021-11:48:51] [V] [TRT] Tactic: 6750207 time 0.059608
[06/29/2021-11:48:51] [V] [TRT] Tactic: 6815743 time 0.184752
[06/29/2021-11:48:51] [V] [TRT] Tactic: 6946815 time 0.147452
[06/29/2021-11:48:51] [V] [TRT] Tactic: 7012351 time 0.04934
[06/29/2021-11:48:52] [V] [TRT] Tactic: 7077887 time 0.107328
[06/29/2021-11:48:52] [V] [TRT] Tactic: 7143423 time 0.17692
[06/29/2021-11:48:52] [V] [TRT] Tactic: 7208959 time 0.207484
[06/29/2021-11:48:52] [V] [TRT] Tactic: 7340031 time 0.090676
[06/29/2021-11:48:52] [V] [TRT] Tactic: 7405567 time 0.094704
[06/29/2021-11:48:52] [V] [TRT] Tactic: 7536639 time 0.299772
[06/29/2021-11:48:52] [V] [TRT] Tactic: 7602175 time 0.147452
[06/29/2021-11:48:52] [V] [TRT] Tactic: 7733247 time 0.124108
[06/29/2021-11:48:52] [V] [TRT] Tactic: 7798783 time 0.171816
[06/29/2021-11:48:52] [V] [TRT] Tactic: 8191999 time 0.09758
[06/29/2021-11:48:52] [V] [TRT] Tactic: 8257535 time 0.081988
[06/29/2021-11:48:52] [V] [TRT] Tactic: 8323071 time 0.112128
[06/29/2021-11:48:52] [V] [TRT] Tactic: 8650751 time 0.14796
[06/29/2021-11:48:52] [V] [TRT] Tactic: 8716287 time 0.102916
[06/29/2021-11:48:52] [V] [TRT] Tactic: 9109503 time 0.05508
[06/29/2021-11:48:52] [V] [TRT] Tactic: 9568255 time 0.074808
[06/29/2021-11:48:52] [V] [TRT] Tactic: 9895935 time 0.144564
[06/29/2021-11:48:52] [V] [TRT] Tactic: 10223615 time 0.418748
[06/29/2021-11:48:52] [V] [TRT] Tactic: 10354687 time 0.106796
[06/29/2021-11:48:52] [V] [TRT] Tactic: 10551295 time 0.2333
[06/29/2021-11:48:52] [V] [TRT] Tactic: 10747903 time 0.119508
[06/29/2021-11:48:52] [V] [TRT] Tactic: 10944511 time 0.201868
[06/29/2021-11:48:52] [V] [TRT] Fastest Tactic: 2097151 Time: 0.04926
[06/29/2021-11:48:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (CaskConvolution)
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: 1754569683116234317 time 0.399088
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: 1825138533642645384 time 0.40386
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: 2733356012094739613 time 0.29212
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: 3915320020053085238 time 0.39776
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: 6808617066150061604 time 0.355316
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: 9091006216302412844 time 0.23424
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: -8060443123034038864 time 0.398072
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: -4420849921117327522 time 0.235864
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: -3946921629105938337 time 0.422504
[06/29/2021-11:48:52] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.23424
[06/29/2021-11:48:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (CudaConvolution)
[06/29/2021-11:48:52] [V] [TRT] Tactic: 0 time 0.120832
[06/29/2021-11:48:52] [V] [TRT] Tactic: 1 time 0.139836
[06/29/2021-11:48:52] [V] [TRT] Tactic: 2 time 0.31238
[06/29/2021-11:48:52] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2424832000, available: 16777216
[06/29/2021-11:48:52] [V] [TRT] Tactic: 5 skipped. Scratch requested: 143998976, available: 16777216
[06/29/2021-11:48:52] [V] [TRT] Tactic: 56 time 0.128908
[06/29/2021-11:48:52] [V] [TRT] Tactic: 57 time 0.235264
[06/29/2021-11:48:52] [V] [TRT] Tactic: 58 time 0.190416
[06/29/2021-11:48:52] [V] [TRT] Tactic: 60 skipped. Scratch requested: 2424832000, available: 16777216
[06/29/2021-11:48:52] [V] [TRT] Tactic: 61 skipped. Scratch requested: 143998976, available: 16777216
[06/29/2021-11:48:52] [V] [TRT] Fastest Tactic: 0 Time: 0.120832
[06/29/2021-11:48:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (CublasConvolution)
[06/29/2021-11:48:52] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2097151
[06/29/2021-11:48:52] [V] [TRT] 
[06/29/2021-11:48:52] [V] [TRT] *************** Autotuning format combination: Float(2048,8192,1,32768) -> Float(512,2048,1,8192) ***************
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (FusedConvActConvolution)
[06/29/2021-11:48:52] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (CaskConvolution)
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: 861694390046228376 time 0.403136
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: 5258189349241541167 time 0.320412
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: 5821621277990374316 time 0.397824
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: 5863767799113001648 time 0.15616
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: -9147980667639709536 time 0.407028
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: -8892196987859366827 time 0.50746
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: -8850904373104590857 time 0.217356
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: -8010679767156598961 time 0.115676
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: -7751035352149795660 time 0.398336
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: -5115676123557684531 time 0.505596
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: -493597327599791285 time 0.20762
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: -423878181466897819 time 0.183296
[06/29/2021-11:48:52] [V] [TRT] Fastest Tactic: -8010679767156598961 Time: 0.115676
[06/29/2021-11:48:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (CudaConvolution)
[06/29/2021-11:48:52] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (CudaDepthwiseConvolution)
[06/29/2021-11:48:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (CublasConvolution)
[06/29/2021-11:48:52] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8010679767156598961
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] 
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:52] [V] [TRT] *************** Autotuning format combination: Float(1,4,16,8192) -> Float(1,4,16,8192) ***************
[06/29/2021-11:48:52] [V] [TRT] *************** Autotuning format combination: Float(512,2048,1,8192) -> Float(512,2048,1,8192) ***************
[06/29/2021-11:48:52] [V] [TRT] *************** Autotuning format combination: Float(1,4,16,8192), Float(1,4,16,32768) -> Float(1,4,16,32768) ***************
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (CaskConvolution)
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: 1754569683116234317 time 0.11072
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: 1825138533642645384 time 0.112664
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: 2733356012094739613 time 0.082684
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: 3915320020053085238 time 0.110116
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: 6808617066150061604 time 0.06912
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:52] [V] [TRT] Tactic: 9091006216302412844 time 0.069228
[06/29/2021-11:48:52] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: -8060443123034038864 time 0.072972
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: -4420849921117327522 time 0.066804
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: -3946921629105938337 time 0.083584
[06/29/2021-11:48:53] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.066804
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (CudaConvolution)
[06/29/2021-11:48:53] [V] [TRT] Tactic: 0 time 0.046212
[06/29/2021-11:48:53] [V] [TRT] Tactic: 1 time 0.066048
[06/29/2021-11:48:53] [V] [TRT] Tactic: 2 time 0.126976
[06/29/2021-11:48:53] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2421293056, available: 16777216
[06/29/2021-11:48:53] [V] [TRT] Tactic: 5 skipped. Scratch requested: 143998976, available: 16777216
[06/29/2021-11:48:53] [V] [TRT] Tactic: 56 time 0.04506
[06/29/2021-11:48:53] [V] [TRT] Tactic: 57 time 0.060868
[06/29/2021-11:48:53] [V] [TRT] Tactic: 58 time 0.129288
[06/29/2021-11:48:53] [V] [TRT] Tactic: 60 skipped. Scratch requested: 2421293056, available: 16777216
[06/29/2021-11:48:53] [V] [TRT] Tactic: 61 skipped. Scratch requested: 143998976, available: 16777216
[06/29/2021-11:48:53] [V] [TRT] Fastest Tactic: 56 Time: 0.04506
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (CublasConvolution)
[06/29/2021-11:48:53] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 56
[06/29/2021-11:48:53] [V] [TRT] 
[06/29/2021-11:48:53] [V] [TRT] *************** Autotuning format combination: Float(512,2048,1,8192), Float(2048,8192,1,32768) -> Float(2048,8192,1,32768) ***************
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (CaskConvolution)
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: 861694390046228376 time 0.110032
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: 5258189349241541167 time 0.060928
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: 5821621277990374316 time 0.107776
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: 5863767799113001648 time 0.038428
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: -9147980667639709536 time 0.109476
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: -8892196987859366827 time 0.20342
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: -8850904373104590857 time 0.06288
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: -8010679767156598961 time 0.039096
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: -7751035352149795660 time 0.108032
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: -5115676123557684531 time 0.109588
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: -493597327599791285 time 0.070252
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: -423878181466897819 time 0.0406
[06/29/2021-11:48:53] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.038428
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (CudaConvolution)
[06/29/2021-11:48:53] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (CublasConvolution)
[06/29/2021-11:48:53] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] 
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:53] [V] [TRT] *************** Autotuning format combination: Float(1,4,16,32768) -> Float(1,4,16,8192) ***************
[06/29/2021-11:48:53] [V] [TRT] *************** Autotuning format combination: Float(2048,8192,1,32768) -> Float(512,2048,1,8192) ***************
[06/29/2021-11:48:53] [V] [TRT] *************** Autotuning format combination: Float(1,4,16,8192) -> Float(1,4,16,8192) ***************
[06/29/2021-11:48:53] [V] [TRT] *************** Autotuning format combination: Float(512,2048,1,8192) -> Float(512,2048,1,8192) ***************
[06/29/2021-11:48:53] [V] [TRT] *************** Autotuning format combination: Float(1,4,16,8192), Float(1,4,16,32768) -> Float(1,4,16,32768) ***************
[06/29/2021-11:48:53] [V] [TRT] *************** Autotuning format combination: Float(512,2048,1,8192), Float(2048,8192,1,32768) -> Float(2048,8192,1,32768) ***************
[06/29/2021-11:48:53] [V] [TRT] *************** Autotuning format combination: Float(1,4,16,32768) -> Float(1,1,1,2048) ***************
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean (Pooling)
[06/29/2021-11:48:53] [V] [TRT] Tactic: -1 time 0.012124
[06/29/2021-11:48:53] [V] [TRT] Fastest Tactic: -1 Time: 0.012124
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean (TiledPooling)
[06/29/2021-11:48:53] [V] [TRT] TiledPooling has no valid tactics for this config, skipping
[06/29/2021-11:48:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -1
[06/29/2021-11:48:53] [V] [TRT] 
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:53] [V] [TRT] Tactic: 1002 time 0.005284
[06/29/2021-11:48:53] [V] [TRT] Tactic: 0 time 0.005156
[06/29/2021-11:48:53] [V] [TRT] Fastest Tactic: 0 Time: 0.005156
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:53] [V] [TRT] Tactic: 1002 time 0.005632
[06/29/2021-11:48:53] [V] [TRT] Tactic: 0 time 0.004188
[06/29/2021-11:48:53] [V] [TRT] Fastest Tactic: 0 Time: 0.004188
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:53] [V] [TRT] Tactic: 1002 time 0.007188
[06/29/2021-11:48:53] [V] [TRT] Tactic: 0 time 0.004284
[06/29/2021-11:48:53] [V] [TRT] Fastest Tactic: 0 Time: 0.004284
[06/29/2021-11:48:53] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,2048) -> Float(1,1,1,3) ***************
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (conv1x1) Set Tactic Name: trt_volta_f32_conv1x1_f32_small_batch
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (FusedConvActConvolution)
[06/29/2021-11:48:53] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (CaskConvolution)
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: 1754569683116234317 time 0.398484
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: 1825138533642645384 time 0.46208
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: 2733356012094739613 time 0.256
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: 3915320020053085238 time 0.39634
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: 6808617066150061604 time 0.235012
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: 9091006216302412844 time 0.230896
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: -8060443123034038864 time 0.309544
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: -4420849921117327522 time 0.203776
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:53] [V] [TRT] Tactic: -3946921629105938337 time 0.259012
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (conv1x1) Set Tactic Name: trt_volta_f32_conv1x1_f32_small_batch
[06/29/2021-11:48:53] [V] [TRT] Tactic: -1243792514564525921 time 0.014044
[06/29/2021-11:48:53] [V] [TRT] Fastest Tactic: -1243792514564525921 Time: 0.014044
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (CudaConvolution)
[06/29/2021-11:48:53] [V] [TRT] Tactic: 0 time 0.120344
[06/29/2021-11:48:53] [V] [TRT] Tactic: 1 time 0.117248
[06/29/2021-11:48:53] [V] [TRT] Tactic: 2 time 0.150428
[06/29/2021-11:48:53] [V] [TRT] Tactic: 4 skipped. Scratch requested: 18898944, available: 16777216
[06/29/2021-11:48:53] [V] [TRT] Tactic: 5 time 0.035668
[06/29/2021-11:48:53] [V] [TRT] Tactic: 56 time 0.122312
[06/29/2021-11:48:53] [V] [TRT] Tactic: 57 time 0.116552
[06/29/2021-11:48:53] [V] [TRT] Tactic: 58 time 0.148264
[06/29/2021-11:48:53] [V] [TRT] Tactic: 60 skipped. Scratch requested: 18898944, available: 16777216
[06/29/2021-11:48:53] [V] [TRT] Tactic: 61 time 0.035288
[06/29/2021-11:48:53] [V] [TRT] Fastest Tactic: 61 Time: 0.035288
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (CudaDepthwiseConvolution)
[06/29/2021-11:48:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (CublasConvolution)
[06/29/2021-11:48:53] [V] [TRT] Tactic: 0 time 0.018176
[06/29/2021-11:48:53] [V] [TRT] Tactic: 1 time 0.029492
[06/29/2021-11:48:53] [V] [TRT] Fastest Tactic: 0 Time: 0.018176
[06/29/2021-11:48:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1243792514564525921
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (conv1x1) Set Tactic Name: trt_volta_f32_conv1x1_f32_small_batch
[06/29/2021-11:48:53] [V] [TRT] 
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (conv1x1) Set Tactic Name: trt_volta_f32_conv1x1_f32_small_batch
[06/29/2021-11:48:53] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (conv1x1) Set Tactic Name: trt_volta_f32_conv1x1_f32_small_batch
[06/29/2021-11:48:53] [V] [TRT] *************** Autotuning format combination: Float(2048,2048,1,2048) -> Float(3,3,1,3) ***************
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (FusedConvActConvolution)
[06/29/2021-11:48:53] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (CaskConvolution)
[06/29/2021-11:48:53] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (CudaConvolution)
[06/29/2021-11:48:53] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (CudaDepthwiseConvolution)
[06/29/2021-11:48:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (CublasConvolution)
[06/29/2021-11:48:53] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: <reformat> (Reformat)
[06/29/2021-11:48:53] [V] [TRT] Tactic: 1002 time 0.005228
[06/29/2021-11:48:53] [V] [TRT] Tactic: 0 time 0.01338
[06/29/2021-11:48:53] [V] [TRT] Fastest Tactic: 1002 Time: 0.005228
[06/29/2021-11:48:53] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,3) -> Float(1,3) ***************
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: copied_squeeze_after_StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (Shuffle)
[06/29/2021-11:48:53] [V] [TRT] Tactic: 0 time 0.003556
[06/29/2021-11:48:53] [V] [TRT] Tactic: 1 time 0.015588
[06/29/2021-11:48:53] [V] [TRT] Fastest Tactic: 0 Time: 0.003556
[06/29/2021-11:48:53] [V] [TRT] *************** Autotuning format combination: Float(1,3) -> Float(1,3) ***************
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/predictions/Softmax (SoftMax)
[06/29/2021-11:48:53] [V] [TRT] Tactic: 1001 time 0.007064
[06/29/2021-11:48:53] [V] [TRT] Fastest Tactic: 1001 Time: 0.007064
[06/29/2021-11:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/ResNet50_my/predictions/Softmax (ExtSoftMax)
[06/29/2021-11:48:54] [V] [TRT] Tactic: 0 time 0.00436
[06/29/2021-11:48:54] [V] [TRT] Fastest Tactic: 0 Time: 0.00436
[06/29/2021-11:48:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ExtSoftMax Tactic: 0
[06/29/2021-11:48:54] [V] [TRT] 
[06/29/2021-11:48:54] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu reformatted input 0 (StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_relu/Relu:0) from Float(1,7,49,12544) to Float(256,1792,1,12544)
[06/29/2021-11:48:54] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu reformatted input 1 (StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_out/Relu:0) from Float(1,7,49,50176) to Float(1024,7168,1,50176)
[06/29/2021-11:48:54] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu reformatted input 0 (StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu:0) from Float(512,2048,1,8192) to Float(1,4,16,8192)
[06/29/2021-11:48:54] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu reformatted input 1 (StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_bn/FusedBatchNormV3:0) from Float(1,4,16,32768) to Float(2048,8192,1,32768)
[06/29/2021-11:48:54] [V] [TRT] Adding reformat layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu output to be reformatted 0 (StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu:0) from Float(1,4,16,32768) to Float(2048,8192,1,32768)
[06/29/2021-11:48:54] [V] [TRT] Formats and tactics selection completed in 31.3526 seconds.
[06/29/2021-11:48:54] [V] [TRT] After reformat layers: 65 layers
[06/29/2021-11:48:54] [V] [TRT] Block size 16777216
[06/29/2021-11:48:54] [V] [TRT] Block size 861184
[06/29/2021-11:48:54] [V] [TRT] Block size 802816
[06/29/2021-11:48:54] [V] [TRT] Block size 401408
[06/29/2021-11:48:54] [V] [TRT] Block size 50176
[06/29/2021-11:48:54] [V] [TRT] Total Activation Memory: 18892800
[06/29/2021-11:48:54] [I] [TRT] Detected 1 inputs and 1 output network tensors.
[06/29/2021-11:48:54] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:54] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:54] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:54] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:54] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:54] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:54] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:54] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1
[06/29/2021-11:48:54] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:54] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1
[06/29/2021-11:48:54] [V] [TRT] StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1
[06/29/2021-11:48:54] [V] [TRT] StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd (conv1x1) Set Tactic Name: trt_volta_f32_conv1x1_f32_small_batch
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv1_conv/Conv2D__7 Weights: 0 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu Weights: 37632 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pad/Pad Weights: 0 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pool/MaxPool Weights: 0 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu Weights: 16384 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu Weights: 147456 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D Weights: 0 HostPersistent: 2176 DevicePersistent: 71680
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu Weights: 0 HostPersistent: 2176 DevicePersistent: 71680
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu Weights: 65536 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_relu/Relu Weights: 147456 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_out/Relu Weights: 0 HostPersistent: 2176 DevicePersistent: 71680
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_relu/Relu Weights: 65536 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_relu/Relu Weights: 147456 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_out/Relu Weights: 0 HostPersistent: 2176 DevicePersistent: 71680
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu Weights: 131072 HostPersistent: 8 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu Weights: 589824 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D Weights: 262144 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu Weights: 0 HostPersistent: 2176 DevicePersistent: 527872
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu Weights: 262144 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_relu/Relu Weights: 589824 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu Weights: 0 HostPersistent: 2176 DevicePersistent: 265728
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_relu/Relu Weights: 262144 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_relu/Relu Weights: 589824 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_out/Relu Weights: 0 HostPersistent: 2176 DevicePersistent: 265728
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_relu/Relu Weights: 262144 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_relu/Relu Weights: 589824 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_out/Relu Weights: 0 HostPersistent: 2176 DevicePersistent: 265728
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu Weights: 524288 HostPersistent: 8 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu Weights: 2359296 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D Weights: 1048576 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu Weights: 2097152 HostPersistent: 8 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu Weights: 1048576 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_relu/Relu Weights: 2359296 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu Weights: 1048576 HostPersistent: 8 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_relu/Relu Weights: 1048576 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_relu/Relu Weights: 2359296 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_out/Relu Weights: 1048576 HostPersistent: 8 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_relu/Relu Weights: 1048576 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_relu/Relu Weights: 2359296 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_out/Relu Weights: 1048576 HostPersistent: 8 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_relu/Relu Weights: 1048576 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_relu/Relu Weights: 2359296 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_out/Relu Weights: 1048576 HostPersistent: 8 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_relu/Relu Weights: 1048576 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_relu/Relu Weights: 2359296 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu input reformatter 1 Weights: 0 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu Weights: 0 HostPersistent: 1664 DevicePersistent: 1053184
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu Weights: 0 HostPersistent: 1664 DevicePersistent: 2099712
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu Weights: 9437184 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D Weights: 4194304 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu input reformatter 1 Weights: 0 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu Weights: 0 HostPersistent: 3200 DevicePersistent: 8397312
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu output reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu Weights: 4194304 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_relu/Relu Weights: 9437184 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu Weights: 4194304 HostPersistent: 8 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_relu/Relu Weights: 4194304 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_relu/Relu Weights: 9437184 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_out/Relu Weights: 4194304 HostPersistent: 8 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean Weights: 0 HostPersistent: 16 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd Weights: 0 HostPersistent: 640 DevicePersistent: 25088
[06/29/2021-11:48:54] [V] [TRT] Layer: StatefulPartitionedCall/ResNet50_my/predictions/Softmax Weights: 0 HostPersistent: 0 DevicePersistent: 0
[06/29/2021-11:48:54] [V] [TRT] Total Host Persistent Memory: 24664
[06/29/2021-11:48:54] [V] [TRT] Total Device Persistent Memory: 13187072
[06/29/2021-11:48:54] [V] [TRT] Total Weight Memory: 80712448
[06/29/2021-11:48:54] [06/29/2021-11:48:54] [V] [TRT] Engine generation completed in 32.4546 seconds.
[06/29/2021-11:48:54] [V] [TRT] Builder timing cache: created 87 entries, 201 hit(s)
[06/29/2021-11:48:54] [V] [TRT] Engine Layer Information:
[06/29/2021-11:48:54] [V] [TRT] Layer(Shuffle): StatefulPartitionedCall/ResNet50_my/resnet50/conv1_conv/Conv2D__7, Tactic: 0, input_layer[Float(112,112,3)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv1_conv/Conv2D__7:0[Float(3,112,112)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): Conv__435 + StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu, Tactic: 131071, StatefulPartitionedCall/ResNet50_my/resnet50/conv1_conv/Conv2D__7:0[Float(3,112,112)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu:0[Float(64,56,56)]
[06/29/2021-11:48:54] [V] [TRT] Layer(Padding): StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pad/Pad, Tactic: 0, StatefulPartitionedCall/ResNet50_my/resnet50/conv1_relu/Relu:0[Float(64,56,56)] -> StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pad/Pad:0[Float(64,58,58)]
[06/29/2021-11:48:54] [V] [TRT] Layer(PoolingTiled): StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pool/MaxPool, Tactic: 1769729, StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pad/Pad:0[Float(64,58,58)] -> StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pool/MaxPool:0[Float(64,28,28)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu, Tactic: 2097151, StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pool/MaxPool:0[Float(64,28,28)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu:0[Float(64,28,28)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu, Tactic: 2621439, StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_1_relu/Relu:0[Float(64,28,28)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu:0[Float(64,28,28)]
[06/29/2021-11:48:54] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_conv/Conv2D, Tactic: -4420849921117327522, StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_2_relu/Relu:0[Float(64,28,28)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_bn/FusedBatchNormV3:0[Float(256,28,28)]
[06/29/2021-11:48:54] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu, Tactic: -4420849921117327522, StatefulPartitionedCall/ResNet50_my/resnet50/pool1_pool/MaxPool:0[Float(64,28,28)], StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_3_bn/FusedBatchNormV3:0[Float(256,28,28)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu:0[Float(256,28,28)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu, Tactic: 9109503, StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu:0[Float(256,28,28)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu:0[Float(64,28,28)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_relu/Relu, Tactic: 2621439, StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_1_relu/Relu:0[Float(64,28,28)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_relu/Relu:0[Float(64,28,28)]
[06/29/2021-11:48:54] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_out/Relu, Tactic: -4420849921117327522, StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_2_relu/Relu:0[Float(64,28,28)], StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block1_out/Relu:0[Float(256,28,28)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_out/Relu:0[Float(256,28,28)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_relu/Relu, Tactic: 9109503, StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_out/Relu:0[Float(256,28,28)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_relu/Relu:0[Float(64,28,28)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_relu/Relu, Tactic: 2621439, StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_1_relu/Relu:0[Float(64,28,28)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_relu/Relu:0[Float(64,28,28)]
[06/29/2021-11:48:54] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_out/Relu, Tactic: -4420849921117327522, StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_2_relu/Relu:0[Float(64,28,28)], StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block2_out/Relu:0[Float(256,28,28)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_out/Relu:0[Float(256,28,28)]
[06/29/2021-11:48:54] [V] [TRT] Layer(Convolution): StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu, Tactic: 0, StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_out/Relu:0[Float(256,28,28)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu:0[Float(128,14,14)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu, Tactic: 10682367, StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_1_relu/Relu:0[Float(128,14,14)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu:0[Float(128,14,14)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_conv/Conv2D, Tactic: 1179647, StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_2_relu/Relu:0[Float(128,14,14)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_bn/FusedBatchNormV3:0[Float(512,14,14)]
[06/29/2021-11:48:54] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu, Tactic: -4420849921117327522, StatefulPartitionedCall/ResNet50_my/resnet50/conv2_block3_out/Relu:0[Float(256,28,28)], StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_3_bn/FusedBatchNormV3:0[Float(512,14,14)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu:0[Float(512,14,14)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu, Tactic: 2097151, StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu:0[Float(512,14,14)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu:0[Float(128,14,14)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_relu/Relu, Tactic: 10682367, StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_1_relu/Relu:0[Float(128,14,14)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_relu/Relu:0[Float(128,14,14)]
[06/29/2021-11:48:54] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu, Tactic: -4420849921117327522, StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_2_relu/Relu:0[Float(128,14,14)], StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block1_out/Relu:0[Float(512,14,14)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu:0[Float(512,14,14)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_relu/Relu, Tactic: 2097151, StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu:0[Float(512,14,14)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_relu/Relu:0[Float(128,14,14)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_relu/Relu, Tactic: 10682367, StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_1_relu/Relu:0[Float(128,14,14)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_relu/Relu:0[Float(128,14,14)]
[06/29/2021-11:48:54] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_out/Relu, Tactic: -4420849921117327522, StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_2_relu/Relu:0[Float(128,14,14)], StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block2_out/Relu:0[Float(512,14,14)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_out/Relu:0[Float(512,14,14)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_relu/Relu, Tactic: 2097151, StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_out/Relu:0[Float(512,14,14)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_relu/Relu:0[Float(128,14,14)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_relu/Relu, Tactic: 10682367, StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_1_relu/Relu:0[Float(128,14,14)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_relu/Relu:0[Float(128,14,14)]
[06/29/2021-11:48:54] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_out/Relu, Tactic: -4420849921117327522, StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_2_relu/Relu:0[Float(128,14,14)], StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block3_out/Relu:0[Float(512,14,14)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_out/Relu:0[Float(512,14,14)]
[06/29/2021-11:48:54] [V] [TRT] Layer(Convolution): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu, Tactic: 56, StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_out/Relu:0[Float(512,14,14)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu:0[Float(256,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu, Tactic: 2621439, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_1_relu/Relu:0[Float(256,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu:0[Float(256,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_conv/Conv2D, Tactic: 2097151, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_2_relu/Relu:0[Float(256,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_bn/FusedBatchNormV3:0[Float(1024,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(Convolution): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu, Tactic: 56, StatefulPartitionedCall/ResNet50_my/resnet50/conv3_block4_out/Relu:0[Float(512,14,14)], StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_3_bn/FusedBatchNormV3:0[Float(1024,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu:0[Float(1024,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu, Tactic: 7012351, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu:0[Float(1024,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu:0[Float(256,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_relu/Relu, Tactic: 2621439, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_1_relu/Relu:0[Float(256,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_relu/Relu:0[Float(256,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(Convolution): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu, Tactic: 0, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_2_relu/Relu:0[Float(256,7,7)], StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block1_out/Relu:0[Float(1024,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu:0[Float(1024,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_relu/Relu, Tactic: 7012351, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu:0[Float(1024,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_relu/Relu:0[Float(256,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_relu/Relu, Tactic: 2621439, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_1_relu/Relu:0[Float(256,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_relu/Relu:0[Float(256,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(Convolution): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_out/Relu, Tactic: 0, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_2_relu/Relu:0[Float(256,7,7)], StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block2_out/Relu:0[Float(1024,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_out/Relu:0[Float(1024,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_relu/Relu, Tactic: 7012351, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_out/Relu:0[Float(1024,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_relu/Relu:0[Float(256,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_relu/Relu, Tactic: 2621439, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_1_relu/Relu:0[Float(256,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_relu/Relu:0[Float(256,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(Convolution): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_out/Relu, Tactic: 0, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_2_relu/Relu:0[Float(256,7,7)], StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block3_out/Relu:0[Float(1024,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_out/Relu:0[Float(1024,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_relu/Relu, Tactic: 7012351, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_out/Relu:0[Float(1024,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_relu/Relu:0[Float(256,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_relu/Relu, Tactic: 2621439, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_1_relu/Relu:0[Float(256,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_relu/Relu:0[Float(256,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(Convolution): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_out/Relu, Tactic: 0, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_2_relu/Relu:0[Float(256,7,7)], StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block4_out/Relu:0[Float(1024,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_out/Relu:0[Float(1024,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_relu/Relu, Tactic: 7012351, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_out/Relu:0[Float(1024,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_relu/Relu:0[Float(256,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_relu/Relu, Tactic: 2621439, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_1_relu/Relu:0[Float(256,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_relu/Relu:0[Float(256,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(Reformat): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu input reformatter 0, Tactic: 1002, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_2_relu/Relu:0[Float(256,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu reformatted input 0[Float(256,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(Reformat): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu input reformatter 1, Tactic: 1002, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block5_out/Relu:0[Float(1024,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu reformatted input 1[Float(1024,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu, Tactic: 5863767799113001648, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu reformatted input 0[Float(256,7,7)], StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu reformatted input 1[Float(1024,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu:0[Float(1024,7,7)]
[06/29/2021-11:48:54] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu, Tactic: 5863767799113001648, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu:0[Float(1024,7,7)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu:0[Float(512,4,4)]
[06/29/2021-11:48:54] [V] [TRT] Layer(Reformat): StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu input reformatter 0, Tactic: 0, StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_1_relu/Relu:0[Float(512,4,4)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu reformatted input 0[Float(512,4,4)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu, Tactic: 10682367, StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu reformatted input 0[Float(512,4,4)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu:0[Float(512,4,4)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_conv/Conv2D, Tactic: 7012351, StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_2_relu/Relu:0[Float(512,4,4)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_bn/FusedBatchNormV3:0[Float(2048,4,4)]
[06/29/2021-11:48:54] [V] [TRT] Layer(Reformat): StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu input reformatter 1, Tactic: 0, StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_3_bn/FusedBatchNormV3:0[Float(2048,4,4)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu reformatted input 1[Float(2048,4,4)]
[06/29/2021-11:48:54] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu, Tactic: -8010679767156598961, StatefulPartitionedCall/ResNet50_my/resnet50/conv4_block6_out/Relu:0[Float(1024,7,7)], StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu reformatted input 1[Float(2048,4,4)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu output to be reformatted 0[Float(2048,4,4)]
[06/29/2021-11:48:54] [V] [TRT] Layer(Reformat): StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu output reformatter 0, Tactic: 1002, StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_0_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu output to be reformatted 0[Float(2048,4,4)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu:0[Float(2048,4,4)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu, Tactic: 2097151, StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu:0[Float(2048,4,4)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu:0[Float(512,4,4)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_relu/Relu, Tactic: 10682367, StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_1_relu/Relu:0[Float(512,4,4)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_relu/Relu:0[Float(512,4,4)]
[06/29/2021-11:48:54] [V] [TRT] Layer(Convolution): StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu, Tactic: 56, StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_2_relu/Relu:0[Float(512,4,4)], StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block1_out/Relu:0[Float(2048,4,4)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu:0[Float(2048,4,4)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_relu/Relu, Tactic: 2097151, StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu:0[Float(2048,4,4)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_relu/Relu:0[Float(512,4,4)]
[06/29/2021-11:48:54] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_relu/Relu, Tactic: 10682367, StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_1_relu/Relu:0[Float(512,4,4)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_relu/Relu:0[Float(512,4,4)]
[06/29/2021-11:48:54] [V] [TRT] Layer(Convolution): StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_3_conv/Conv2D + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_add/add + StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_out/Relu, Tactic: 56, StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_2_relu/Relu:0[Float(512,4,4)], StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block2_out/Relu:0[Float(2048,4,4)] -> StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_out/Relu:0[Float(2048,4,4)]
[06/29/2021-11:48:54] [V] [TRT] Layer(Pooling): StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean, Tactic: -1, StatefulPartitionedCall/ResNet50_my/resnet50/conv5_block3_out/Relu:0[Float(2048,4,4)] -> StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean:0[Float(2048,1,1)]
[06/29/2021-11:48:54] [V] [TRT] Layer(conv1x1): StatefulPartitionedCall/ResNet50_my/predictions/MatMul + StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd, Tactic: -1243792514564525921, StatefulPartitionedCall/ResNet50_my/global_avg_pool/Mean:0[Float(2048,1,1)] -> StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd_out_tensor[Float(3,1,1)]
[06/29/2021-11:48:54] [V] [TRT] Layer(ExtSoftMax): StatefulPartitionedCall/ResNet50_my/predictions/Softmax, Tactic: 0, StatefulPartitionedCall/ResNet50_my/predictions/BiasAdd:0[Float(3)] -> predictions[Float(3)]
[06/29/2021-11:48:54] [I] Engine built in 33.1013 sec.
[06/29/2021-11:48:54] [06/29/2021-11:48:54] [V] [TRT] Allocated persistent device memory of size 13187072
[06/29/2021-11:48:54] [V] [TRT] Allocated activation device memory of size 2196480
[06/29/2021-11:48:54] [V] [TRT] Assigning persistent memory blocks for various profiles
[06/29/2021-11:48:54] [I] Starting inference
[06/29/2021-11:48:57] [I] Warmup completed 0 queries over 200 ms
[06/29/2021-11:48:57] [I] Timing trace has 0 queries over 3.00314 s
[06/29/2021-11:48:57] [I] Trace averages of 10 runs:
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51364 ms - Host latency: 1.56639 ms (end to end 2.88989 ms, enqueue 0.387379 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.5142 ms - Host latency: 1.55782 ms (end to end 2.92382 ms, enqueue 0.420187 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51447 ms - Host latency: 1.55918 ms (end to end 2.91763 ms, enqueue 0.391815 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51239 ms - Host latency: 1.5536 ms (end to end 2.92261 ms, enqueue 0.389153 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.54292 ms - Host latency: 1.5886 ms (end to end 2.9696 ms, enqueue 0.398044 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51056 ms - Host latency: 1.55956 ms (end to end 2.89679 ms, enqueue 0.441241 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.5053 ms - Host latency: 1.56036 ms (end to end 2.88038 ms, enqueue 0.404254 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.59416 ms - Host latency: 1.64852 ms (end to end 3.0063 ms, enqueue 0.405676 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50873 ms - Host latency: 1.55156 ms (end to end 3.01079 ms, enqueue 0.386374 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.49941 ms - Host latency: 1.54112 ms (end to end 2.89304 ms, enqueue 0.417252 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.61912 ms - Host latency: 1.65931 ms (end to end 3.1439 ms, enqueue 0.394931 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.49844 ms - Host latency: 1.54104 ms (end to end 2.90066 ms, enqueue 0.394318 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.61348 ms - Host latency: 1.65673 ms (end to end 3.11432 ms, enqueue 0.392361 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50468 ms - Host latency: 1.54608 ms (end to end 2.93115 ms, enqueue 0.389374 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.60613 ms - Host latency: 2.62399 ms (end to end 4.58096 ms, enqueue 0.406122 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51886 ms - Host latency: 1.56028 ms (end to end 2.89718 ms, enqueue 0.401279 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.5109 ms - Host latency: 1.55048 ms (end to end 2.92395 ms, enqueue 0.451364 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.5199 ms - Host latency: 1.5604 ms (end to end 2.9475 ms, enqueue 0.391974 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51118 ms - Host latency: 1.55106 ms (end to end 2.93649 ms, enqueue 0.384869 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51638 ms - Host latency: 1.55567 ms (end to end 2.93287 ms, enqueue 0.394101 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.5129 ms - Host latency: 1.55487 ms (end to end 2.91865 ms, enqueue 0.425079 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51479 ms - Host latency: 1.55291 ms (end to end 2.93129 ms, enqueue 0.394397 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50795 ms - Host latency: 1.55114 ms (end to end 2.9187 ms, enqueue 0.419275 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51541 ms - Host latency: 1.55916 ms (end to end 2.92944 ms, enqueue 0.400653 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.61003 ms - Host latency: 1.65577 ms (end to end 3.11855 ms, enqueue 0.397174 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51177 ms - Host latency: 1.55272 ms (end to end 2.92454 ms, enqueue 0.391333 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51058 ms - Host latency: 1.55088 ms (end to end 2.92468 ms, enqueue 0.391656 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.58903 ms - Host latency: 1.63009 ms (end to end 3.07498 ms, enqueue 0.437939 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51476 ms - Host latency: 1.55493 ms (end to end 2.93081 ms, enqueue 0.396259 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50763 ms - Host latency: 1.54584 ms (end to end 2.92555 ms, enqueue 0.393433 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.5869 ms - Host latency: 1.62971 ms (end to end 3.11342 ms, enqueue 0.391595 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50323 ms - Host latency: 1.54465 ms (end to end 2.91963 ms, enqueue 0.387311 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50818 ms - Host latency: 1.54975 ms (end to end 2.92041 ms, enqueue 0.425427 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.56747 ms - Host latency: 1.61031 ms (end to end 3.0713 ms, enqueue 0.443341 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50884 ms - Host latency: 1.5508 ms (end to end 2.92886 ms, enqueue 0.386237 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.5131 ms - Host latency: 1.55546 ms (end to end 2.93586 ms, enqueue 0.397363 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.60291 ms - Host latency: 1.64285 ms (end to end 3.08671 ms, enqueue 0.442194 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50984 ms - Host latency: 1.55194 ms (end to end 2.92956 ms, enqueue 0.390674 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.63687 ms - Host latency: 1.67814 ms (end to end 3.23129 ms, enqueue 0.407654 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50537 ms - Host latency: 1.54963 ms (end to end 2.91071 ms, enqueue 0.424487 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51156 ms - Host latency: 1.55273 ms (end to end 2.92442 ms, enqueue 0.39267 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.6348 ms - Host latency: 1.67454 ms (end to end 3.22259 ms, enqueue 0.430383 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50867 ms - Host latency: 1.54958 ms (end to end 2.93262 ms, enqueue 0.389105 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51249 ms - Host latency: 1.55261 ms (end to end 2.93214 ms, enqueue 0.39184 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.6429 ms - Host latency: 1.68163 ms (end to end 3.20787 ms, enqueue 0.458997 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50416 ms - Host latency: 1.54489 ms (end to end 2.92323 ms, enqueue 0.395813 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51056 ms - Host latency: 1.55183 ms (end to end 2.92287 ms, enqueue 0.393988 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.6441 ms - Host latency: 1.68281 ms (end to end 3.22358 ms, enqueue 0.395422 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50561 ms - Host latency: 1.54605 ms (end to end 2.92214 ms, enqueue 0.388245 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50737 ms - Host latency: 1.54801 ms (end to end 2.92156 ms, enqueue 0.393738 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.63635 ms - Host latency: 1.67606 ms (end to end 3.22918 ms, enqueue 0.43797 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50612 ms - Host latency: 1.54854 ms (end to end 2.91586 ms, enqueue 0.388641 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51017 ms - Host latency: 1.55154 ms (end to end 2.92825 ms, enqueue 0.385931 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50428 ms - Host latency: 1.54535 ms (end to end 2.91991 ms, enqueue 0.386658 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.64629 ms - Host latency: 1.69037 ms (end to end 3.21907 ms, enqueue 0.428394 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51549 ms - Host latency: 1.55905 ms (end to end 2.94049 ms, enqueue 0.390454 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.64797 ms - Host latency: 1.68683 ms (end to end 3.23834 ms, enqueue 0.391675 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51213 ms - Host latency: 1.55186 ms (end to end 2.93014 ms, enqueue 0.388232 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.66753 ms - Host latency: 1.70834 ms (end to end 3.23326 ms, enqueue 0.433838 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51476 ms - Host latency: 1.55521 ms (end to end 2.93468 ms, enqueue 0.392725 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.64579 ms - Host latency: 1.68607 ms (end to end 3.22632 ms, enqueue 0.393481 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50886 ms - Host latency: 1.55178 ms (end to end 2.92805 ms, enqueue 0.393811 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51445 ms - Host latency: 1.55239 ms (end to end 2.93101 ms, enqueue 0.391846 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.64049 ms - Host latency: 1.6821 ms (end to end 3.21862 ms, enqueue 0.428381 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50515 ms - Host latency: 1.54854 ms (end to end 2.90605 ms, enqueue 0.409912 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50853 ms - Host latency: 1.54811 ms (end to end 2.92645 ms, enqueue 0.401636 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.63774 ms - Host latency: 1.67965 ms (end to end 3.23268 ms, enqueue 0.388721 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50865 ms - Host latency: 1.55031 ms (end to end 2.91842 ms, enqueue 0.415881 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51127 ms - Host latency: 1.55256 ms (end to end 2.92662 ms, enqueue 0.390637 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.64304 ms - Host latency: 1.68549 ms (end to end 3.22142 ms, enqueue 0.426672 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51084 ms - Host latency: 1.55144 ms (end to end 2.92417 ms, enqueue 0.391907 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50823 ms - Host latency: 1.54694 ms (end to end 2.92144 ms, enqueue 0.388086 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.64272 ms - Host latency: 1.68438 ms (end to end 3.21842 ms, enqueue 0.427686 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51023 ms - Host latency: 1.55115 ms (end to end 2.92417 ms, enqueue 0.404871 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50735 ms - Host latency: 1.54844 ms (end to end 2.92339 ms, enqueue 0.389929 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.64775 ms - Host latency: 1.68734 ms (end to end 3.23265 ms, enqueue 0.394019 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.5088 ms - Host latency: 1.54862 ms (end to end 2.91022 ms, enqueue 0.440479 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.53953 ms - Host latency: 1.5772 ms (end to end 2.95406 ms, enqueue 0.396863 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.59785 ms - Host latency: 1.64041 ms (end to end 3.17471 ms, enqueue 0.439978 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.57313 ms - Host latency: 1.61499 ms (end to end 2.97529 ms, enqueue 0.400293 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.58519 ms - Host latency: 1.62703 ms (end to end 3.17759 ms, enqueue 0.41438 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50807 ms - Host latency: 1.54684 ms (end to end 2.92489 ms, enqueue 0.39375 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.59976 ms - Host latency: 1.63846 ms (end to end 3.01896 ms, enqueue 0.386853 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50923 ms - Host latency: 1.54948 ms (end to end 3.01407 ms, enqueue 0.390186 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50842 ms - Host latency: 1.54785 ms (end to end 2.921 ms, enqueue 0.390735 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50774 ms - Host latency: 1.54672 ms (end to end 2.91627 ms, enqueue 0.395728 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50858 ms - Host latency: 1.54767 ms (end to end 2.92629 ms, enqueue 0.39104 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50398 ms - Host latency: 1.54236 ms (end to end 2.91522 ms, enqueue 0.39187 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.5076 ms - Host latency: 1.54689 ms (end to end 2.92435 ms, enqueue 0.386633 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51423 ms - Host latency: 1.55229 ms (end to end 2.9323 ms, enqueue 0.394861 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51132 ms - Host latency: 1.55184 ms (end to end 2.93297 ms, enqueue 0.391174 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50439 ms - Host latency: 1.54531 ms (end to end 2.92457 ms, enqueue 0.384924 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50725 ms - Host latency: 1.54821 ms (end to end 2.92377 ms, enqueue 0.384753 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51578 ms - Host latency: 1.55525 ms (end to end 2.94254 ms, enqueue 0.384448 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50917 ms - Host latency: 1.54952 ms (end to end 2.93105 ms, enqueue 0.387939 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50604 ms - Host latency: 1.54698 ms (end to end 2.92937 ms, enqueue 0.386438 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50773 ms - Host latency: 1.54685 ms (end to end 2.92581 ms, enqueue 0.386707 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50959 ms - Host latency: 1.54871 ms (end to end 2.92634 ms, enqueue 0.391614 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50822 ms - Host latency: 1.54757 ms (end to end 2.91301 ms, enqueue 0.395422 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.5042 ms - Host latency: 1.54639 ms (end to end 2.91898 ms, enqueue 0.385449 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.5144 ms - Host latency: 1.55775 ms (end to end 2.92535 ms, enqueue 0.423779 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51646 ms - Host latency: 1.55756 ms (end to end 2.94147 ms, enqueue 0.389014 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50765 ms - Host latency: 1.54675 ms (end to end 2.92584 ms, enqueue 0.386487 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50944 ms - Host latency: 1.54973 ms (end to end 2.91598 ms, enqueue 0.390601 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51091 ms - Host latency: 1.55088 ms (end to end 2.92347 ms, enqueue 0.391284 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51434 ms - Host latency: 1.55494 ms (end to end 2.93369 ms, enqueue 0.439771 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51116 ms - Host latency: 1.55516 ms (end to end 2.92766 ms, enqueue 0.430872 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51074 ms - Host latency: 1.5505 ms (end to end 2.92867 ms, enqueue 0.393115 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.58411 ms - Host latency: 1.62528 ms (end to end 3.10389 ms, enqueue 0.395789 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50789 ms - Host latency: 1.54801 ms (end to end 2.9236 ms, enqueue 0.388965 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50366 ms - Host latency: 1.54399 ms (end to end 2.91967 ms, enqueue 0.383948 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50364 ms - Host latency: 1.54452 ms (end to end 2.91886 ms, enqueue 0.387317 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.56344 ms - Host latency: 1.60991 ms (end to end 3.0577 ms, enqueue 0.428247 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.5032 ms - Host latency: 1.54283 ms (end to end 2.92222 ms, enqueue 0.385889 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.58632 ms - Host latency: 1.62728 ms (end to end 3.11162 ms, enqueue 0.391821 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50861 ms - Host latency: 1.55015 ms (end to end 2.93175 ms, enqueue 0.383936 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50878 ms - Host latency: 1.54888 ms (end to end 2.9275 ms, enqueue 0.388123 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50825 ms - Host latency: 1.54927 ms (end to end 2.92012 ms, enqueue 0.390625 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.64764 ms - Host latency: 1.68977 ms (end to end 3.22788 ms, enqueue 0.431287 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50916 ms - Host latency: 1.54934 ms (end to end 2.9228 ms, enqueue 0.390576 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.64421 ms - Host latency: 1.68608 ms (end to end 3.21956 ms, enqueue 0.432471 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50742 ms - Host latency: 1.54956 ms (end to end 2.91951 ms, enqueue 0.415601 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.64612 ms - Host latency: 1.69026 ms (end to end 3.22712 ms, enqueue 0.390332 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51399 ms - Host latency: 1.55527 ms (end to end 2.92935 ms, enqueue 0.393896 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.6418 ms - Host latency: 1.68271 ms (end to end 3.17068 ms, enqueue 0.420312 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50889 ms - Host latency: 1.55183 ms (end to end 2.9636 ms, enqueue 0.392871 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50508 ms - Host latency: 1.54307 ms (end to end 2.91675 ms, enqueue 0.389746 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.65059 ms - Host latency: 1.69656 ms (end to end 3.225 ms, enqueue 0.427051 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50989 ms - Host latency: 1.54988 ms (end to end 2.93535 ms, enqueue 0.387256 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50645 ms - Host latency: 1.54832 ms (end to end 2.92419 ms, enqueue 0.388647 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50693 ms - Host latency: 1.54512 ms (end to end 2.91455 ms, enqueue 0.392163 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.64421 ms - Host latency: 1.6865 ms (end to end 3.22002 ms, enqueue 0.429858 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.5072 ms - Host latency: 1.54749 ms (end to end 2.9208 ms, enqueue 0.396802 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.64465 ms - Host latency: 1.69023 ms (end to end 3.22834 ms, enqueue 0.391431 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50869 ms - Host latency: 1.54705 ms (end to end 2.91921 ms, enqueue 0.393823 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.5063 ms - Host latency: 1.54617 ms (end to end 2.92471 ms, enqueue 0.390137 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.63079 ms - Host latency: 1.67097 ms (end to end 3.2168 ms, enqueue 0.438062 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51235 ms - Host latency: 1.55039 ms (end to end 2.93381 ms, enqueue 0.391089 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.6355 ms - Host latency: 1.67673 ms (end to end 3.21975 ms, enqueue 0.392993 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50508 ms - Host latency: 1.54829 ms (end to end 2.91472 ms, enqueue 0.38667 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.5002 ms - Host latency: 1.54319 ms (end to end 2.9053 ms, enqueue 0.428638 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.64697 ms - Host latency: 1.69297 ms (end to end 3.22634 ms, enqueue 0.392261 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50728 ms - Host latency: 1.54668 ms (end to end 2.92407 ms, enqueue 0.393848 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.64509 ms - Host latency: 1.6925 ms (end to end 3.20764 ms, enqueue 0.463208 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50664 ms - Host latency: 1.54463 ms (end to end 2.91785 ms, enqueue 0.392261 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51079 ms - Host latency: 1.55139 ms (end to end 2.93166 ms, enqueue 0.385034 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.65024 ms - Host latency: 1.69478 ms (end to end 3.23032 ms, enqueue 0.429932 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51167 ms - Host latency: 1.55117 ms (end to end 2.92537 ms, enqueue 0.390625 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.65344 ms - Host latency: 1.697 ms (end to end 3.23533 ms, enqueue 0.425415 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51599 ms - Host latency: 1.55876 ms (end to end 2.94067 ms, enqueue 0.385327 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51018 ms - Host latency: 1.54939 ms (end to end 2.92681 ms, enqueue 0.382129 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.65227 ms - Host latency: 1.69595 ms (end to end 3.25168 ms, enqueue 0.390479 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50623 ms - Host latency: 1.54929 ms (end to end 2.9292 ms, enqueue 0.383398 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51016 ms - Host latency: 1.5498 ms (end to end 2.92451 ms, enqueue 0.390771 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.65852 ms - Host latency: 1.69775 ms (end to end 3.25625 ms, enqueue 0.392407 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51147 ms - Host latency: 1.55427 ms (end to end 2.92759 ms, enqueue 0.390259 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.65535 ms - Host latency: 1.69954 ms (end to end 3.24988 ms, enqueue 0.425464 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.5074 ms - Host latency: 1.54695 ms (end to end 2.92019 ms, enqueue 0.392017 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50491 ms - Host latency: 1.54729 ms (end to end 2.91824 ms, enqueue 0.386206 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.67786 ms - Host latency: 1.72065 ms (end to end 3.25015 ms, enqueue 0.435986 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50996 ms - Host latency: 1.54946 ms (end to end 2.9311 ms, enqueue 0.392163 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50466 ms - Host latency: 1.54697 ms (end to end 2.92104 ms, enqueue 0.386206 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.68337 ms - Host latency: 1.72544 ms (end to end 3.21033 ms, enqueue 0.414282 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50454 ms - Host latency: 1.55288 ms (end to end 3.01467 ms, enqueue 0.431812 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.53975 ms - Host latency: 1.58137 ms (end to end 2.95918 ms, enqueue 0.44165 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.61021 ms - Host latency: 1.66714 ms (end to end 3.29321 ms, enqueue 0.458984 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50479 ms - Host latency: 1.54539 ms (end to end 2.92153 ms, enqueue 0.426538 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.645 ms - Host latency: 1.6845 ms (end to end 3.08184 ms, enqueue 0.385889 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.57356 ms - Host latency: 1.61931 ms (end to end 3.19199 ms, enqueue 0.437085 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50017 ms - Host latency: 1.53811 ms (end to end 2.92227 ms, enqueue 0.391455 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.68489 ms - Host latency: 1.72395 ms (end to end 3.23784 ms, enqueue 0.387183 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50056 ms - Host latency: 1.54514 ms (end to end 3.01604 ms, enqueue 0.434106 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.68638 ms - Host latency: 1.72576 ms (end to end 3.33132 ms, enqueue 0.38855 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51377 ms - Host latency: 1.5532 ms (end to end 2.9501 ms, enqueue 0.393896 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.6822 ms - Host latency: 1.724 ms (end to end 3.32329 ms, enqueue 0.424756 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51951 ms - Host latency: 1.57292 ms (end to end 2.9499 ms, enqueue 0.483301 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.51152 ms - Host latency: 1.55413 ms (end to end 2.93621 ms, enqueue 0.398145 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.65649 ms - Host latency: 1.69895 ms (end to end 3.27041 ms, enqueue 0.39436 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50442 ms - Host latency: 1.54348 ms (end to end 2.93547 ms, enqueue 0.392749 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50242 ms - Host latency: 1.54055 ms (end to end 2.93254 ms, enqueue 0.38584 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.65576 ms - Host latency: 1.69751 ms (end to end 3.25632 ms, enqueue 0.425464 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50571 ms - Host latency: 1.54448 ms (end to end 2.93259 ms, enqueue 0.38999 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50234 ms - Host latency: 1.5437 ms (end to end 2.92568 ms, enqueue 0.38855 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.65007 ms - Host latency: 1.69209 ms (end to end 3.23567 ms, enqueue 0.433252 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50347 ms - Host latency: 1.54192 ms (end to end 2.92766 ms, enqueue 0.390601 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.65449 ms - Host latency: 1.70146 ms (end to end 3.26472 ms, enqueue 0.420264 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50208 ms - Host latency: 1.54302 ms (end to end 2.92312 ms, enqueue 0.413794 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.57961 ms - Host latency: 1.61877 ms (end to end 3.01287 ms, enqueue 0.384717 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.57952 ms - Host latency: 1.61946 ms (end to end 3.17468 ms, enqueue 0.50166 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.50046 ms - Host latency: 1.54197 ms (end to end 2.93535 ms, enqueue 0.38811 ms)
[06/29/2021-11:48:57] [I] Average on 10 runs - GPU latency: 1.6282 ms - Host latency: 1.6804 ms (end to end 3.25496 ms, enqueue 0.388428 ms)
[06/29/2021-11:48:57] [I] Host Latency
[06/29/2021-11:48:57] [I] min: 1.49683 ms (end to end 1.67804 ms)
[06/29/2021-11:48:57] [I] max: 11.2261 ms (end to end 12.6029 ms)
[06/29/2021-11:48:57] [I] mean: 1.59507 ms (end to end 3.01962 ms)
[06/29/2021-11:48:57] [I] median: 1.54861 ms (end to end 2.92505 ms)
[06/29/2021-11:48:57] [I] percentile: 2.62012 ms at 99% (end to end 4.48108 ms at 99%)
[06/29/2021-11:48:57] [I] throughput: 0 qps
[06/29/2021-11:48:57] [I] walltime: 3.00314 s
[06/29/2021-11:48:57] [I] Enqueue Time
[06/29/2021-11:48:57] [I] min: 0.37854 ms
[06/29/2021-11:48:57] [I] max: 1.0813 ms
[06/29/2021-11:48:57] [I] median: 0.388794 ms
[06/29/2021-11:48:57] [I] GPU Compute
[06/29/2021-11:48:57] [I] min: 1.45502 ms
[06/29/2021-11:48:57] [I] max: 3.28882 ms
[06/29/2021-11:48:57] [I] mean: 1.54833 ms
[06/29/2021-11:48:57] [I] median: 1.50757 ms
[06/29/2021-11:48:57] [I] percentile: 2.55939 ms at 99%
[06/29/2021-11:48:57] [I] total compute time: 2.95731 s
&&&& PASSED TensorRT.trtexec # TensorRT-7.2.3.4\bin\trtexec.exe --onnx=D:\TensorRT_forum\model.onnx --verbose